Sep 25 14:52:05 devstack cinder-volume[75610]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 25 14:52:05 devstack cinder-volume[75610]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 25 14:52:05 devstack cinder-volume[75610]: we strongly recommend against using it for new projects.
Sep 25 14:52:05 devstack cinder-volume[75610]: If you are already using Eventlet, we recommend migrating to a different
Sep 25 14:52:05 devstack cinder-volume[75610]: framework.  For more detail see
Sep 25 14:52:05 devstack cinder-volume[75610]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 25 14:52:05 devstack cinder-volume[75610]:   import eventlet  # noqa
Sep 25 14:52:07 devstack cinder-volume[75610]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75610) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 14:52:07 devstack cinder-volume[75610]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75610) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 14:52:07 devstack cinder-volume[75610]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75610) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 14:52:08 devstack cinder-volume[75610]: INFO dbcounter [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Registered counter for database cinder
Sep 25 14:52:08 devstack cinder-volume[75610]: DEBUG oslo_db.sqlalchemy.engines [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75610) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 14:52:09 devstack cinder-volume[75610]: DEBUG dbcounter [-] [75610] Writer thread running {{(pid=75610) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 14:52:09 devstack cinder-volume[75610]: INFO cinder.rpc [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 25 14:52:09 devstack cinder-volume[75610]: INFO cinder.rpc [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 25 14:52:09 devstack cinder-volume[75610]: DEBUG oslo_db.sqlalchemy.engines [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75610) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 14:52:09 devstack cinder-volume[75610]: INFO cinder.volume.manager [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Determined volume DB was empty at startup.
Sep 25 14:52:09 devstack cinder-volume[75610]: DEBUG cinder.volume.manager [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75610) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 25 14:52:09 devstack cinder-volume[75610]: INFO cinder.volume.manager [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 25 14:52:09 devstack cinder-volume[75610]: WARNING stevedore.named [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 14:52:09 devstack cinder-volume[75610]: WARNING castellan.key_manager [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 14:52:09 devstack cinder-volume[75610]: WARNING cinder.keymgr.conf_key_mgr [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 14:52:09 devstack cinder-volume[75610]: DEBUG cinder.volume.drivers.lvm [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75610) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 25 14:52:09 devstack cinder-volume[75610]: DEBUG oslo_concurrency.processutils [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75610) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:09 devstack cinder-volume[75610]: DEBUG oslo_concurrency.processutils [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] CMD "cinder-rtstool verify" returned: 0 in 0.449s {{(pid=75610) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_db.sqlalchemy.engines [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75610) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 14:52:10 devstack cinder-volume[75610]: INFO cinder.rpc [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 25 14:52:10 devstack cinder-volume[75610]: INFO cinder.rpc [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 25 14:52:10 devstack cinder-volume[75610]: WARNING stevedore.named [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 14:52:10 devstack cinder-volume[75610]: WARNING castellan.key_manager [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 14:52:10 devstack cinder-volume[75610]: INFO cinder.volume.manager [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_db.sqlalchemy.engines [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75610) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 14:52:10 devstack cinder-volume[75610]: INFO oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Starting 1 workers
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Started child 75765 {{(pid=75610) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Full set of CONF: {{(pid=75610) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] ******************************************************************************** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Configuration options gathered from: {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] ================================================================================ {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] allow_availability_zone_fallback = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] allow_compression_on_image_upload = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] allowed_direct_url_schemes     = [] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] api_rate_limit                 = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] auth_strategy                  = keystone {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] az_cache_duration              = 3600 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_availability_zone      = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_host                   = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75765]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_name                   = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_stats_polling_interval = 60 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backup_api_class               = cinder.backup.api.API {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backup_name_template           = backup-%s {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backup_use_same_host           = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backup_use_temp_snapshot       = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] chap_password                  = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] chap_username                  =  {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cinder_internal_tenant_project_id = 8b92a884dc24458f90179d195e710c35 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cinder_internal_tenant_user_id = edff7a035a8a4dfaa068fed0244de23e {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cloned_volume_same_az          = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cluster                        = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] compression_format             = gzip {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] config_dir                     = [] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] config_source                  = [] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] control_exchange               = openstack {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] debug                          = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] default_availability_zone      = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] default_group_type             = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] default_volume_type            = lvmdriver-1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] disk_geometry                  = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] driver_client_cert             = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] driver_client_cert_key         = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] driver_data_namespace          = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] driver_ssl_cert_path           = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] driver_ssl_cert_verify         = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] driver_use_ssl                 = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] enable_force_upload            = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] enable_new_services            = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] enable_unsupported_driver      = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] enforce_multipath_for_image_xfer = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] filter_function                = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance_api_insecure            = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance_api_servers             = ['http://192.168.122.155/image'] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance_api_ssl_compression     = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance_ca_certificates_file    = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance_certfile                = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance_keyfile                 = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance_num_retries             = 3 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance_request_timeout         = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] goodness_function              = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] graceful_shutdown_timeout      = 5 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] group_api_class                = cinder.group.api.API {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] host                           = devstack {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] image_compress_on_upload       = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] image_conversion_address_space_limit = 1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] image_conversion_cpu_limit     = 60 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75765]: INFO cinder.volume.manager [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] image_conversion_disable       = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] image_introspection_address_space_limit = 1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] image_introspection_cpu_limit  = 60 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] image_upload_use_cinder_backend = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] image_upload_use_internal_tenant = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] image_volume_cache_enabled     = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] image_volume_cache_max_count   = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] image_volume_cache_max_size_gb = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] init_host_max_objects_retrieval = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] iscsi_target_flags             =  {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] iscsi_write_cache              = on {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] iser_helper                    = tgtadm {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] iser_ip_address                = 192.168.122.155 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] iser_port                      = 3260 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] log_color                      = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] log_config_append              = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] log_dir                        = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] log_file                       = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] log_options                    = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] log_rotate_interval            = 1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] log_rotate_interval_type       = days {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] log_rotation_type              = none {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] max_age                        = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] max_logfile_count              = 30 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] max_logfile_size_mb            = 200 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] max_over_subscription_ratio    = 20.0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] message_reap_interval          = 86400 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] message_ttl                    = 2592000 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] migration_create_volume_timeout_secs = 300 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:10 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] monkey_patch                   = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] monkey_patch_modules           = [] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] my_ip                          = 192.168.122.155 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] no_snapshot_gb_quota           = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] num_iser_scan_tries            = 3 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] num_shell_tries                = 3 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] num_volume_device_scan_tries   = 3 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] nvmeof_conn_info_version       = 1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] nvmet_ns_id                    = 10 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] nvmet_port_id                  = 1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] osapi_max_limit                = 1000 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] osapi_volume_ext_list          = [] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] osapi_volume_listen_port       = 8776 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] osapi_volume_use_ssl           = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] osapi_volume_workers           = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] per_volume_size_limit          = -1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] periodic_fuzzy_delay           = 60 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] periodic_interval              = 60 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] public_endpoint                = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] publish_errors                 = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] quota_backup_gigabytes         = 1000 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] quota_backups                  = 10 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] quota_gigabytes                = 1000 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] quota_groups                   = 10 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] quota_snapshots                = 10 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] quota_volumes                  = 10 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] rate_limit_burst               = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] rate_limit_except_level        = CRITICAL {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] rate_limit_interval            = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] reinit_driver_count            = 3 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] replication_device             = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] report_discard_supported       = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] report_interval                = 120 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] reservation_clean_interval     = 86400 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] reservation_expire             = 86400 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] reserved_image_namespaces      = [] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] reserved_percentage            = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] rpc_response_timeout           = 120 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] run_external_periodic_tasks    = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] scst_target_driver             = iscsi {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] scst_target_iqn_name           = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] service_down_time              = 720 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] shell_completion               = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] snapshot_name_template         = snapshot-%s {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] snapshot_same_host             = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] split_loggers                  = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] state_path                     = /opt/stack/data/cinder {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] storage_availability_zone      = nova {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] storage_protocol               = iSCSI {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] syslog_log_facility            = LOG_USER {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] target_helper                  = lioadm {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] target_ip_address              = 192.168.122.155 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] target_port                    = 3260 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] target_protocol                = iscsi {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] target_secondary_ip_addresses  = [] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] trace_flags                    = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] transport_url                  = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] until_refresh                  = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] use_chap_auth                  = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] use_default_quota_class        = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] use_journal                    = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] use_json                       = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] use_multipath_for_image_xfer   = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] use_stderr                     = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] use_syslog                     = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] verify_glance_signatures       = enabled {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] volume_api_class               = cinder.volume.api.API {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] volume_backend_name            = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] volume_clear                   = zero {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] volume_clear_ionice            = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] volume_clear_size              = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] volume_copy_bps_limit          = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] volume_dd_blocksize            = 1M {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] volume_name_template           = volume-%s {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] volume_service_inithost_offload = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] volume_usage_audit_period      = month {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] zoning_mode                    = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_concurrency.disable_process_locking = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.auth_section = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.auth_type   = password {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack sudo[75769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.auth_version = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.cache       = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.certfile    = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.include_service_catalog = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.insecure    = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.interface   = public {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack sudo[75769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.keyfile     = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcache_password = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcache_username = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.region_name = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.service_type = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.155/identity {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.backend                  = dogpile.cache.null {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.backend_argument         = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.backend_expiration_time  = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.config_prefix            = cache.oslo {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.debug_cache_backend      = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.enable_retry_client      = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.enable_socket_keepalive  = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.enabled                  = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.expiration_time          = 600 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.hashclient_retry_attempts = 2 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.memcache_dead_retry      = 300 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.memcache_sasl_enabled    = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.password                 = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.proxies                  = [] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.redis_db                 = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.redis_server             = localhost:6379 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.retry_attempts           = 2 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.retry_delay              = 0.0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.socket_keepalive_count   = 1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.socket_keepalive_idle    = 1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.socket_keepalive_interval = 1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.socket_timeout           = 1.0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.tls_allowed_ciphers      = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.tls_cafile               = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.tls_certfile             = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.tls_enabled              = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.tls_keyfile              = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cache.username                 = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] coordination.backend_url       = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.asyncio_connection    = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.asyncio_slave_connection = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.backend               = sqlalchemy {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.connection            = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.connection_debug      = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.connection_parameters =  {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.connection_recycle_time = 3600 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.connection_trace      = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.db_inc_retry_interval = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.db_max_retries        = 20 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.db_max_retry_interval = 10 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.db_retry_interval     = 1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.max_overflow          = 50 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.max_pool_size         = 5 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.max_retries           = 10 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.mysql_wsrep_sync_wait = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.pool_timeout          = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.retry_interval        = 10 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.slave_connection      = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.sqlite_synchronous    = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.synchronous_reader    = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] database.use_db_reconnect      = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_tracing.insecure = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] profiler.connection_string     = messaging:// {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] profiler.enabled               = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] profiler.es_doc_type           = notification {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] profiler.es_scroll_size        = 10000 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] profiler.es_scroll_time        = 2m {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] profiler.filter_error_trace    = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] profiler.hmac_keys             = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] profiler.sentinel_service_name = mymaster {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] profiler.socket_timeout        = 0.1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] profiler.trace_requests        = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] profiler.trace_sqlalchemy      = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] profiler_jaeger.process_tags   = {} {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] profiler_jaeger.service_name_prefix = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] profiler_otlp.service_name_prefix = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_policy.enforce_new_defaults = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_policy.policy_default_rule = default {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] privsep_osbrick.group          = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] privsep_osbrick.helper_command = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] privsep_osbrick.user           = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cinder_sys_admin.group         = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cinder_sys_admin.helper_command = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] cinder_sys_admin.user          = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] service_user.auth_section      = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] service_user.auth_type         = password {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] service_user.cafile            = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] service_user.certfile          = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] service_user.collect_timing    = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] service_user.insecure          = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] service_user.keyfile           = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] service_user.send_service_user_token = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] service_user.split_loggers     = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] service_user.timeout           = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] service_user.tls_ciphers       = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] service_user.tls_min_version   = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance.auth_section            = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance.auth_type               = password {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance.certfile                = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance.collect_timing          = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance.insecure                = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance.keyfile                 = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance.region_name             = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance.split_loggers           = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance.timeout                 = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance.tls_ciphers             = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] glance.tls_min_version         = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.backend_availability_zone = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.chap_password = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.chap_username =  {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.disk_geometry = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.driver_client_cert = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.driver_client_cert_key = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.driver_data_namespace = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.driver_use_ssl = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.extra_capabilities = {} {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.filter_function = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.goodness_function = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.iscsi_target_flags =  {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.iscsi_write_cache = on {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.iser_ip_address = 192.168.122.155 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.iser_port     = 3260 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.lvm_share_target = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.lvm_type      = auto {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.num_shell_tries = 3 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.replication_device = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.report_discard_supported = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.reserved_percentage = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.target_helper = tgtadm {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.target_ip_address = 192.168.122.155 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.target_port   = 3260 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.target_protocol = iscsi {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.trace_flags   = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.unique_fqdn_network = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.use_chap_auth = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.volume_backend_name = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.volume_clear  = zero {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.volume_clear_ionice = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.volume_clear_size = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_reports.file_event_handler = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_reports.log_dir           = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.backend_host       = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.chap_password      = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.chap_username      = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.disk_geometry      = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.driver_client_cert = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.extra_capabilities = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.filter_function    = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.goodness_function  = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.iser_helper        = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.iser_port          = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.lvm_type           = auto {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.replication_device = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.report_discard_supported = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.reserved_percentage = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.scst_target_driver = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.storage_protocol   = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.target_ip_address  = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.target_port        = 3260 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.trace_flags        = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.volume_clear       = zero {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] lvmdriver-1.volumes_dir        = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_notifications.driver = [] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_notifications.retry = -1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] key_manager.fixed_key          = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.barbican_api_version  = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.barbican_endpoint     = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.barbican_endpoint_type = public {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.barbican_region_name  = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.cafile                = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.certfile              = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.collect_timing        = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.insecure              = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.keyfile               = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.number_of_retries     = 60 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.retry_delay           = 1 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.send_service_user_token = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.split_loggers         = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.timeout               = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.tls_ciphers           = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.tls_min_version       = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.verify_ssl            = True {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican.verify_ssl_path       = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican_service_user.auth_section = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican_service_user.auth_type = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican_service_user.cafile   = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican_service_user.certfile = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican_service_user.collect_timing = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican_service_user.insecure = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican_service_user.keyfile  = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican_service_user.split_loggers = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican_service_user.timeout  = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican_service_user.tls_ciphers = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] barbican_service_user.tls_min_version = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] vault.approle_role_id          = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] vault.approle_secret_id        = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] vault.auth_method              = approle {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] vault.auth_path                = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] vault.kv_mountpoint            = secret {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] vault.kv_path                  = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] vault.kv_version               = 2 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] vault.namespace                = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] vault.root_token_id            = **** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] vault.ssl_ca_crt_file          = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] vault.timeout                  = 60.0 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] vault.token_file               = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] vault.token_role               = None {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] vault.use_ssl                  = False {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:52:10 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] ******************************************************************************** {{(pid=75610) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 25 14:52:10 devstack sudo[75769]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:10 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:10 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:10 devstack sudo[75805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 14:52:10 devstack sudo[75805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:10 devstack sudo[75805]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:10 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.256s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:10 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 14:52:10 devstack cinder-volume[75765]: INFO cinder.brick.local_dev.lvm [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 25 14:52:10 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:10 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:10 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:10 devstack sudo[75937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 14:52:10 devstack sudo[75937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:11 devstack sudo[75937]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:11 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:11 devstack cinder-volume[75765]: DEBUG cinder.brick.local_dev.lvm [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75765) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 25 14:52:11 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:11 devstack sudo[76053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 14:52:11 devstack sudo[76053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:11 devstack sudo[76053]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:11 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.521s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:11 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:11 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:11 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:11 devstack sudo[76281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 14:52:11 devstack sudo[76281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:11 devstack sudo[76281]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:11 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.303s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:11 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:11 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:11 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:12 devstack sudo[76375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 25 14:52:12 devstack sudo[76375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:12 devstack sudo[76375]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:12 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.260s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:12 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:12 devstack sudo[76378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 14:52:12 devstack sudo[76378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:12 devstack sudo[76378]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:12 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:12 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:12 devstack sudo[76461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 14:52:12 devstack sudo[76461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:12 devstack sudo[76461]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:12 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:12 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:12 devstack sudo[76464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 14:52:12 devstack sudo[76464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:13 devstack sudo[76464]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:13 devstack sudo[76517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 14:52:13 devstack sudo[76517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:13 devstack sudo[76517]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.320s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:13 devstack sudo[76557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 14:52:13 devstack sudo[76557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:13 devstack sudo[76557]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:13 devstack cinder-volume[75765]: INFO cinder.volume.drivers.lvm [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 25 14:52:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:13 devstack sudo[76561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 14:52:13 devstack sudo[76561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:14 devstack sudo[76561]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:14 devstack cinder-volume[75765]: DEBUG cinder.volume.drivers.lvm [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Updating volume stats {{(pid=75765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 14:52:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:14 devstack sudo[76564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 14:52:14 devstack sudo[76564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:14 devstack sudo[76564]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:14 devstack sudo[76567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 14:52:14 devstack sudo[76567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:14 devstack sudo[76567]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:14 devstack sudo[76576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 14:52:14 devstack sudo[76576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:14 devstack sudo[76576]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:14 devstack sudo[76579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 14:52:14 devstack sudo[76579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:15 devstack sudo[76579]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:15 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:15 devstack cinder-volume[75765]: INFO cinder.volume.driver [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Driver hasn't implemented _init_vendor_properties()
Sep 25 14:52:15 devstack cinder-volume[75765]: DEBUG cinder.volume.driver [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75765) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 25 14:52:15 devstack cinder-volume[75765]: DEBUG oslo_db.sqlalchemy.engines [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75765) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 14:52:15 devstack cinder-volume[75765]: DEBUG dbcounter [-] [75765] Writer thread running {{(pid=75765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 14:52:15 devstack cinder-volume[75765]: DEBUG cinder.db.api [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Building query based on filter {{(pid=75765) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 25 14:52:15 devstack cinder-volume[75765]: DEBUG cinder.image.image_utils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75765) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 25 14:52:15 devstack cinder-volume[75765]: INFO cinder.keymgr.migration [None req-7ff4fea5-dbc4-41e4-a34f-436145f4cdcd None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 25 14:52:15 devstack cinder-volume[75765]: DEBUG cinder.volume.drivers.lvm [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Updating volume stats {{(pid=75765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 14:52:15 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:15 devstack sudo[76583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 14:52:15 devstack sudo[76583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:15 devstack sudo[76583]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:15 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:15 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:15 devstack sudo[76588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 14:52:15 devstack sudo[76588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:15 devstack sudo[76588]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:15 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:15 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:15 devstack sudo[76591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 14:52:15 devstack sudo[76591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:16 devstack sudo[76591]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:16 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:16 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:16 devstack sudo[76594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 14:52:16 devstack sudo[76594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:16 devstack sudo[76594]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:16 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:16 devstack cinder-volume[75765]: DEBUG cinder.manager [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Notifying Schedulers of capabilities ... {{(pid=75765) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 14:52:16 devstack cinder-volume[75765]: INFO cinder.volume.manager [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Driver initialization completed successfully.
Sep 25 14:52:16 devstack cinder-volume[75765]: INFO cinder.manager [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Initiating service 2 cleanup
Sep 25 14:52:16 devstack cinder-volume[75765]: INFO cinder.manager [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Service 2 cleanup completed.
Sep 25 14:52:16 devstack cinder-volume[75765]: DEBUG cinder.service [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Creating RPC server for service cinder-volume {{(pid=75765) start /opt/stack/cinder/cinder/service.py:231}}
Sep 25 14:52:16 devstack cinder-volume[75765]: DEBUG cinder.service [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75765) start /opt/stack/cinder/cinder/service.py:237}}
Sep 25 14:52:16 devstack cinder-volume[75765]: INFO cinder.volume.manager [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 25 14:52:16 devstack cinder-volume[75765]: DEBUG cinder.volume.drivers.lvm [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Updating volume stats {{(pid=75765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 14:52:16 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:16 devstack sudo[76598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 14:52:16 devstack sudo[76598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:16 devstack sudo[76598]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:16 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:16 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:16 devstack sudo[76603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 14:52:16 devstack sudo[76603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:17 devstack sudo[76603]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:17 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:17 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:17 devstack sudo[76606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 14:52:17 devstack sudo[76606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:17 devstack sudo[76606]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:17 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:17 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:52:17 devstack sudo[76609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 14:52:17 devstack sudo[76609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:52:17 devstack sudo[76609]: pam_unix(sudo:session): session closed for user root
Sep 25 14:52:17 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:52:17 devstack cinder-volume[75765]: INFO cinder.volume.manager [None req-eb088aff-84d5-4ef0-9d3f-c6ab16a454b2 None None] Driver post RPC initialization completed successfully.
Sep 25 14:52:20 devstack cinder-volume[75610]: DEBUG dbcounter [-] [75610] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75610) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 14:52:26 devstack cinder-volume[75765]: DEBUG dbcounter [-] [75765] Writing DB stats cinder:SELECT=2 {{(pid=75765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 14:52:27 devstack cinder-volume[75765]: DEBUG dbcounter [-] [75765] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 14:53:13 devstack cinder-volume[75765]: DEBUG oslo_service.periodic_task [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 14:53:13 devstack cinder-volume[75765]: DEBUG cinder.volume.drivers.lvm [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Updating volume stats {{(pid=75765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 14:53:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:53:13 devstack sudo[78583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 14:53:13 devstack sudo[78583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:53:13 devstack sudo[78583]: pam_unix(sudo:session): session closed for user root
Sep 25 14:53:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:53:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:53:13 devstack sudo[78586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 14:53:13 devstack sudo[78586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:53:14 devstack sudo[78586]: pam_unix(sudo:session): session closed for user root
Sep 25 14:53:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:53:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:53:14 devstack sudo[78589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 14:53:14 devstack sudo[78589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:53:14 devstack sudo[78589]: pam_unix(sudo:session): session closed for user root
Sep 25 14:53:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:53:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:53:14 devstack sudo[78592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 14:53:14 devstack sudo[78592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:53:14 devstack sudo[78592]: pam_unix(sudo:session): session closed for user root
Sep 25 14:53:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:53:14 devstack cinder-volume[75765]: DEBUG cinder.manager [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Notifying Schedulers of capabilities ... {{(pid=75765) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 14:53:14 devstack cinder-volume[75765]: DEBUG oslo_service.periodic_task [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running periodic task VolumeManager._thread_info {{(pid=75765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 14:53:14 devstack cinder-volume[75765]: DEBUG cinder.volume.manager [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] thread count: 6 {{(pid=75765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 14:53:14 devstack cinder-volume[75765]: DEBUG cinder.volume.manager [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] thread info: [<_MainThread(MainThread, started 124869832851584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124869718430592)>, <Thread(Thread-3 (stat_writer), started daemon 124869718626624)>, <Thread(Rabbit-heartbeat, started daemon 124869718440192)>, <Thread(Thread-5 (_runner), started daemon 124869718120128)>, <Thread(Thread-7 (_runner), started daemon 124869718232448)>] {{(pid=75765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 14:54:13 devstack cinder-volume[75765]: DEBUG oslo_service.periodic_task [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 14:54:13 devstack cinder-volume[75765]: DEBUG cinder.volume.drivers.lvm [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Updating volume stats {{(pid=75765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 14:54:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:54:13 devstack sudo[81887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 14:54:13 devstack sudo[81887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:54:13 devstack sudo[81887]: pam_unix(sudo:session): session closed for user root
Sep 25 14:54:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:54:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:54:13 devstack sudo[81891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 14:54:13 devstack sudo[81891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:54:14 devstack sudo[81891]: pam_unix(sudo:session): session closed for user root
Sep 25 14:54:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:54:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:54:14 devstack sudo[81895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 14:54:14 devstack sudo[81895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:54:14 devstack sudo[81895]: pam_unix(sudo:session): session closed for user root
Sep 25 14:54:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:54:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:54:14 devstack sudo[81898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 14:54:14 devstack sudo[81898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:54:14 devstack sudo[81898]: pam_unix(sudo:session): session closed for user root
Sep 25 14:54:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:54:14 devstack cinder-volume[75765]: DEBUG cinder.manager [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Notifying Schedulers of capabilities ... {{(pid=75765) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 14:54:27 devstack cinder-volume[75765]: DEBUG dbcounter [-] [75765] Writing DB stats cinder:SELECT=1 {{(pid=75765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 14:54:27 devstack cinder-volume[75765]: DEBUG dbcounter [-] [75765] Writing DB stats cinder:UPDATE=1 {{(pid=75765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 14:55:13 devstack cinder-volume[75765]: DEBUG oslo_service.periodic_task [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 14:55:13 devstack cinder-volume[75765]: DEBUG cinder.volume.drivers.lvm [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Updating volume stats {{(pid=75765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 14:55:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:55:13 devstack sudo[84157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 14:55:13 devstack sudo[84157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:55:13 devstack sudo[84157]: pam_unix(sudo:session): session closed for user root
Sep 25 14:55:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:55:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:55:14 devstack sudo[84165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 14:55:14 devstack sudo[84165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:55:14 devstack sudo[84165]: pam_unix(sudo:session): session closed for user root
Sep 25 14:55:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:55:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:55:14 devstack sudo[84174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 14:55:14 devstack sudo[84174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:55:14 devstack sudo[84174]: pam_unix(sudo:session): session closed for user root
Sep 25 14:55:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:55:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:55:14 devstack sudo[84182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 14:55:14 devstack sudo[84182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:55:14 devstack sudo[84182]: pam_unix(sudo:session): session closed for user root
Sep 25 14:55:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:55:14 devstack cinder-volume[75765]: DEBUG cinder.manager [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Notifying Schedulers of capabilities ... {{(pid=75765) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 14:55:14 devstack cinder-volume[75765]: DEBUG oslo_service.periodic_task [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running periodic task VolumeManager._thread_info {{(pid=75765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 14:55:14 devstack cinder-volume[75765]: DEBUG cinder.volume.manager [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] thread count: 6 {{(pid=75765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 14:55:14 devstack cinder-volume[75765]: DEBUG cinder.volume.manager [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] thread info: [<_MainThread(MainThread, started 124869832851584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124869718430592)>, <Thread(Thread-3 (stat_writer), started daemon 124869718626624)>, <Thread(Rabbit-heartbeat, started daemon 124869718440192)>, <Thread(Thread-5 (_runner), started daemon 124869718120128)>, <Thread(Thread-7 (_runner), started daemon 124869718232448)>] {{(pid=75765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 14:56:13 devstack cinder-volume[75765]: DEBUG oslo_service.periodic_task [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 14:56:13 devstack cinder-volume[75765]: DEBUG cinder.volume.drivers.lvm [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Updating volume stats {{(pid=75765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 14:56:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:56:13 devstack sudo[85511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 14:56:13 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:56:13 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root
Sep 25 14:56:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:56:13 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:56:14 devstack sudo[85514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 14:56:14 devstack sudo[85514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:56:14 devstack sudo[85514]: pam_unix(sudo:session): session closed for user root
Sep 25 14:56:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:56:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:56:14 devstack sudo[85523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 14:56:14 devstack sudo[85523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:56:14 devstack sudo[85523]: pam_unix(sudo:session): session closed for user root
Sep 25 14:56:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:56:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:56:14 devstack sudo[85526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 14:56:14 devstack sudo[85526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:56:14 devstack sudo[85526]: pam_unix(sudo:session): session closed for user root
Sep 25 14:56:14 devstack cinder-volume[75765]: DEBUG oslo_concurrency.processutils [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:56:14 devstack cinder-volume[75765]: DEBUG cinder.manager [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Notifying Schedulers of capabilities ... {{(pid=75765) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 14:56:14 devstack cinder-volume[75765]: DEBUG oslo_service.periodic_task [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] Running periodic task VolumeManager._thread_info {{(pid=75765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 14:56:14 devstack cinder-volume[75765]: DEBUG cinder.volume.manager [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] thread count: 6 {{(pid=75765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 14:56:14 devstack cinder-volume[75765]: DEBUG cinder.volume.manager [None req-ee92d6ef-f3a3-4521-aeed-a6310c2ed9e5 None None] thread info: [<_MainThread(MainThread, started 124869832851584)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124869718430592)>, <Thread(Thread-3 (stat_writer), started daemon 124869718626624)>, <Thread(Rabbit-heartbeat, started daemon 124869718440192)>, <Thread(Thread-5 (_runner), started daemon 124869718120128)>, <Thread(Thread-7 (_runner), started daemon 124869718232448)>] {{(pid=75765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 14:56:27 devstack cinder-volume[75765]: DEBUG dbcounter [-] [75765] Writing DB stats cinder:SELECT=1 {{(pid=75765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 14:56:27 devstack cinder-volume[75765]: DEBUG dbcounter [-] [75765] Writing DB stats cinder:UPDATE=1 {{(pid=75765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 14:56:43 devstack cinder-volume[75610]: INFO oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Caught SIGTERM, stopping children
Sep 25 14:56:43 devstack cinder-volume[75610]: DEBUG oslo_concurrency.lockutils [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Acquiring lock "singleton_lock" {{(pid=75610) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 14:56:43 devstack cinder-volume[75610]: DEBUG oslo_concurrency.lockutils [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Acquired lock "singleton_lock" {{(pid=75610) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 14:56:43 devstack cinder-volume[75610]: DEBUG oslo_concurrency.lockutils [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Releasing lock "singleton_lock" {{(pid=75610) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 14:56:43 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Stop services. {{(pid=75610) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 25 14:56:43 devstack cinder-volume[75610]: DEBUG oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Killing children. {{(pid=75610) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 25 14:56:43 devstack cinder-volume[75610]: INFO oslo_service.backend._eventlet.service [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Waiting on 1 children to exit
Sep 25 14:56:48 devstack cinder-volume[75765]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Sep 25 14:56:48 devstack cinder-volume[86211]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 25 14:56:48 devstack cinder-volume[86211]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 25 14:56:48 devstack cinder-volume[86211]: we strongly recommend against using it for new projects.
Sep 25 14:56:48 devstack cinder-volume[86211]: If you are already using Eventlet, we recommend migrating to a different
Sep 25 14:56:48 devstack cinder-volume[86211]: framework.  For more detail see
Sep 25 14:56:48 devstack cinder-volume[86211]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 25 14:56:48 devstack cinder-volume[86211]:   import eventlet  # noqa
Sep 25 14:56:50 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 14:56:50 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 14:56:50 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 14:56:51 devstack cinder-volume[86211]: INFO dbcounter [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Registered counter for database cinder
Sep 25 14:56:51 devstack cinder-volume[86211]: DEBUG oslo_db.sqlalchemy.engines [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 14:56:51 devstack cinder-volume[75765]: DEBUG oslo_concurrency.lockutils [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Acquiring lock "singleton_lock" {{(pid=75765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 14:56:51 devstack cinder-volume[75765]: DEBUG oslo_concurrency.lockutils [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Acquired lock "singleton_lock" {{(pid=75765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 14:56:51 devstack cinder-volume[75765]: DEBUG oslo_concurrency.lockutils [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Releasing lock "singleton_lock" {{(pid=75765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 14:56:51 devstack cinder-volume[75765]: WARNING amqp [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 14:56:51 devstack cinder-volume[75765]: WARNING amqp [None req-4bbd08fb-bc7c-4175-b0a6-1159e8af1db0 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 14:56:51 devstack cinder-volume[86211]: DEBUG dbcounter [-] [86211] Writer thread running {{(pid=86211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 14:56:51 devstack cinder-volume[86211]: INFO cinder.rpc [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 25 14:56:51 devstack cinder-volume[86211]: INFO cinder.rpc [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 25 14:56:51 devstack cinder-volume[86211]: DEBUG oslo_db.sqlalchemy.engines [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 14:56:51 devstack cinder-volume[86211]: INFO cinder.volume.manager [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Determined volume DB was empty at startup.
Sep 25 14:56:51 devstack cinder-volume[86211]: DEBUG cinder.volume.manager [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86211) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 25 14:56:51 devstack cinder-volume[86211]: INFO cinder.volume.manager [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 25 14:56:51 devstack cinder-volume[86211]: WARNING stevedore.named [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 14:56:51 devstack cinder-volume[86211]: WARNING castellan.key_manager [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 14:56:51 devstack cinder-volume[86211]: WARNING cinder.keymgr.conf_key_mgr [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 14:56:51 devstack cinder-volume[86211]: INFO cinder.volume.manager [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_db.sqlalchemy.engines [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 14:56:52 devstack cinder-volume[86211]: INFO oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Starting 1 workers
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Started child 86430 {{(pid=86211) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Full set of CONF: {{(pid=86211) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] ******************************************************************************** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Configuration options gathered from: {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] ================================================================================ {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] allow_availability_zone_fallback = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] allow_compression_on_image_upload = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] allowed_direct_url_schemes     = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] api_rate_limit                 = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] auth_strategy                  = keystone {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_availability_zone      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_host                   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_name                   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_stats_polling_interval = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backup_api_class               = cinder.backup.api.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backup_name_template           = backup-%s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backup_use_same_host           = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backup_use_temp_snapshot       = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] chap_password                  = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] chap_username                  =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cinder_internal_tenant_project_id = 8b92a884dc24458f90179d195e710c35 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cinder_internal_tenant_user_id = edff7a035a8a4dfaa068fed0244de23e {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cluster                        = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] compression_format             = gzip {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] compute_api_class              = cinder.compute.nova.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] config_dir                     = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] config_source                  = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86430]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] control_exchange               = openstack {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] debug                          = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] default_availability_zone      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] default_group_type             = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] default_volume_type            = QuobyteHD {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] disk_geometry                  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] driver_client_cert             = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] driver_client_cert_key         = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] driver_data_namespace          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] driver_ssl_cert_path           = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] driver_ssl_cert_verify         = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] driver_use_ssl                 = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] enable_new_services            = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] enable_unsupported_driver      = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] enabled_backends               = ['QuobyteHD'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] enforce_multipath_for_image_xfer = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] filter_function                = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance_api_insecure            = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance_api_servers             = ['http://192.168.122.155/image'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance_api_ssl_compression     = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance_ca_certificates_file    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance_catalog_info            = image:glance:publicURL {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance_certfile                = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance_keyfile                 = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance_num_retries             = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance_request_timeout         = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] goodness_function              = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] graceful_shutdown_timeout      = 5 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] group_api_class                = cinder.group.api.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] host                           = devstack {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] image_compress_on_upload       = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] image_conversion_address_space_limit = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] image_conversion_cpu_limit     = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] image_conversion_disable       = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] image_introspection_address_space_limit = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] image_introspection_cpu_limit  = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] image_upload_use_cinder_backend = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] image_upload_use_internal_tenant = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] image_volume_cache_enabled     = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] image_volume_cache_max_count   = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] image_volume_cache_max_size_gb = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] init_host_max_objects_retrieval = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] instance_format                = [instance: %(uuid)s]  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] iscsi_target_flags             =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] iscsi_write_cache              = on {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] iser_helper                    = tgtadm {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] iser_ip_address                = 192.168.122.155 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] iser_port                      = 3260 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] log_color                      = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] log_config_append              = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] log_dir                        = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] log_file                       = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] log_options                    = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] log_rotate_interval            = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] log_rotate_interval_type       = days {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] log_rotation_type              = none {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] max_age                        = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] max_logfile_count              = 30 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] max_logfile_size_mb            = 200 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] max_over_subscription_ratio    = 20.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] message_reap_interval          = 86400 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] message_ttl                    = 2592000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] migration_create_volume_timeout_secs = 300 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] monkey_patch                   = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] monkey_patch_modules           = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] my_ip                          = 192.168.122.155 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] no_snapshot_gb_quota           = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] num_iser_scan_tries            = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] num_shell_tries                = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] num_volume_device_scan_tries   = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] nvmeof_conn_info_version       = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] nvmet_ns_id                    = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] nvmet_port_id                  = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] osapi_max_limit                = 1000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] osapi_volume_ext_list          = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] osapi_volume_listen_port       = 8776 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] osapi_volume_use_ssl           = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] osapi_volume_workers           = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] per_volume_size_limit          = -1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] periodic_fuzzy_delay           = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] periodic_interval              = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] public_endpoint                = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] publish_errors                 = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] quota_backup_gigabytes         = 1000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] quota_backups                  = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86430]: INFO cinder.volume.manager [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 25 14:56:52 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.remotefs [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86430) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] quota_gigabytes                = 1000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] quota_groups                   = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] quota_snapshots                = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] quota_volumes                  = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] rate_limit_burst               = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] rate_limit_except_level        = CRITICAL {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] rate_limit_interval            = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] reinit_driver_count            = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] replication_device             = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] report_discard_supported       = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] report_interval                = 120 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] reservation_clean_interval     = 86400 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] reservation_expire             = 86400 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] reserved_image_namespaces      = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] reserved_percentage            = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] rpc_response_timeout           = 120 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] run_external_periodic_tasks    = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] scst_target_driver             = iscsi {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] scst_target_iqn_name           = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] service_down_time              = 720 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] shell_completion               = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] snapshot_name_template         = snapshot-%s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] split_loggers                  = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] state_path                     = /opt/stack/data/cinder {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] storage_availability_zone      = nova {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] storage_protocol               = iSCSI {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] syslog_log_facility            = LOG_USER {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] target_helper                  = lioadm {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] target_ip_address              = 192.168.122.155 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] target_port                    = 3260 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] target_protocol                = iscsi {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] target_secondary_ip_addresses  = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] trace_flags                    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] transport_url                  = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] until_refresh                  = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] use_chap_auth                  = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] use_default_quota_class        = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] use_journal                    = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] use_json                       = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] use_multipath_for_image_xfer   = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] use_stderr                     = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] use_syslog                     = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] verify_glance_signatures       = enabled {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] volume_api_class               = cinder.volume.api.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] volume_backend_name            = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] volume_clear                   = zero {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] volume_clear_ionice            = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] volume_clear_size              = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] volume_copy_bps_limit          = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] volume_dd_blocksize            = 1M {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] volume_name_template           = volume-%s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] volume_service_inithost_offload = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] volume_usage_audit_period      = month {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] zoning_mode                    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_concurrency.disable_process_locking = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.auth_section = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.auth_type   = password {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.auth_version = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.cache       = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.certfile    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.delay_auth_decision = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.http_connect_timeout = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.include_service_catalog = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.insecure    = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.interface   = public {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.keyfile     = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcache_password = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcache_username = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.region_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.service_token_roles_required = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.service_type = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.token_cache_time = 300 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.155/identity {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.backend                  = dogpile.cache.null {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.backend_argument         = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.backend_expiration_time  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.config_prefix            = cache.oslo {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.debug_cache_backend      = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.enable_retry_client      = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.enable_socket_keepalive  = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.enabled                  = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.expiration_time          = 600 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.hashclient_retry_attempts = 2 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.memcache_dead_retry      = 300 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.memcache_pool_maxsize    = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.memcache_sasl_enabled    = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.password                 = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.proxies                  = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.redis_db                 = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.redis_sentinel_service_name = mymaster {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.redis_server             = localhost:6379 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.retry_attempts           = 2 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.retry_delay              = 0.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.socket_keepalive_count   = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.socket_keepalive_idle    = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.socket_keepalive_interval = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.socket_timeout           = 1.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.tls_allowed_ciphers      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.tls_cafile               = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.tls_certfile             = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.tls_enabled              = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.tls_keyfile              = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cache.username                 = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] coordination.backend_url       = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.asyncio_connection    = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.asyncio_slave_connection = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.backend               = sqlalchemy {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.connection            = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.connection_debug      = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.connection_parameters =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.connection_recycle_time = 3600 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86430) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 25 14:56:52 devstack cinder-volume[86430]: WARNING cinder.volume.drivers.quobyte [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 25 14:56:52 devstack cinder-volume[86430]: WARNING cinder.volume.drivers.quobyte [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.connection_trace      = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.db_inc_retry_interval = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.db_max_retries        = 20 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.db_max_retry_interval = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.db_retry_interval     = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.max_overflow          = 50 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.max_pool_size         = 5 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.max_retries           = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.mysql_wsrep_sync_wait = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.pool_timeout          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Running cmd (subprocess): mount.quobyte {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.retry_interval        = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.slave_connection      = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.sqlite_synchronous    = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.synchronous_reader    = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] database.use_db_reconnect      = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_tracing.insecure = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] profiler.connection_string     = messaging:// {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] profiler.enabled               = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] profiler.es_doc_type           = notification {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] profiler.es_scroll_size        = 10000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] profiler.es_scroll_time        = 2m {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] profiler.filter_error_trace    = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] profiler.hmac_keys             = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] profiler.sentinel_service_name = mymaster {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] profiler.socket_timeout        = 0.1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] profiler.trace_requests        = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] profiler.trace_sqlalchemy      = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] profiler_jaeger.process_tags   = {} {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] profiler_jaeger.service_name_prefix = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] profiler_otlp.service_name_prefix = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_policy.enforce_new_defaults = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_policy.policy_default_rule = default {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_policy.policy_file        = policy.yaml {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] privsep_osbrick.group          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] privsep_osbrick.helper_command = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] privsep_osbrick.user           = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cinder_sys_admin.group         = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cinder_sys_admin.helper_command = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] cinder_sys_admin.user          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] service_user.auth_section      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] service_user.auth_type         = password {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] service_user.cafile            = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] service_user.certfile          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] service_user.collect_timing    = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] service_user.insecure          = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] service_user.keyfile           = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] service_user.send_service_user_token = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] service_user.split_loggers     = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] service_user.timeout           = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] service_user.tls_ciphers       = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] service_user.tls_min_version   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance.auth_section            = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance.auth_type               = password {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance.certfile                = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance.collect_timing          = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance.insecure                = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance.keyfile                 = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance.region_name             = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance.split_loggers           = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance.timeout                 = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance.tls_ciphers             = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] glance.tls_min_version         = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.backend_availability_zone = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.chap_password = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.chap_username =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.disk_geometry = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.driver_client_cert = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.driver_client_cert_key = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.driver_data_namespace = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.driver_use_ssl = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.enable_unsupported_driver = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.extra_capabilities = {} {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.filter_function = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.goodness_function = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.iscsi_target_flags =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.iscsi_write_cache = on {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.iser_helper   = tgtadm {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.iser_ip_address = 192.168.122.155 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.iser_port     = 3260 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.nas_host      =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.nas_login     = admin {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.nas_mount_options = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.nas_password  = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.nas_private_key =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.nas_share_path =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.num_shell_tries = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.nvmet_port_id = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.quobyte_client_cfg = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.quobyte_volume_url = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.replication_device = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.report_discard_supported = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.reserved_percentage = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.scst_target_driver = iscsi {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.scst_target_iqn_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.storage_protocol = iSCSI {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.target_helper = tgtadm {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.target_ip_address = 192.168.122.155 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.target_port   = 3260 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.target_protocol = iscsi {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.trace_flags   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack quobyte-client[86433]: Reading configuration file: /etc/quobyte/client.cfg
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.unique_fqdn_network = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.use_chap_auth = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.volume_backend_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.volume_clear  = zero {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.volume_clear_ionice = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.volume_clear_size = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack quobyte-client[86433]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_reports.file_event_handler = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_reports.log_dir           = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.backend_availability_zone = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.backend_host         = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.chap_password        = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.chap_username        = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.chiscsi_conf         = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.disk_geometry        = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.driver_client_cert   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.driver_client_cert_key = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.driver_data_namespace = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.driver_use_ssl       = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.extra_capabilities   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.filter_function      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.goodness_function    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.iser_helper          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.iser_ip_address      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.iser_port            = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.iser_target_prefix   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.nas_host             = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.nas_login            = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.nas_mount_options    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.nas_password         = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.nas_private_key      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.nas_share_path       = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.nas_ssh_port         = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.num_shell_tries      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] CMD "mount.quobyte" returned: 1 in 0.124s {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.nvmet_port_id        = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=86430) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 14:56:52 devstack cinder-volume[86430]: INFO cinder.volume.drivers.quobyte [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf ...
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 -c /etc/quobyte/client-cinder.cfg {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.replication_device   = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.report_discard_supported = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.reserved_percentage  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.scst_target_driver   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.storage_protocol     = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.target_helper        = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.target_ip_address    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.target_port          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.target_prefix        = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.target_protocol      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.trace_flags          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.use_chap_auth        = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.volume_clear         = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.volume_clear_size    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] QuobyteHD.volumes_dir          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack sudo[86437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 -c /etc/quobyte/client-cinder.cfg
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.ssl      = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_notifications.driver = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_notifications.retry = -1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] oslo_messaging_notifications.transport_url = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] key_manager.fixed_key          = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.barbican_api_version  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.barbican_endpoint     = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.barbican_endpoint_type = public {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.barbican_region_name  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.cafile                = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.certfile              = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.collect_timing        = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.insecure              = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.keyfile               = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.number_of_retries     = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.retry_delay           = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.send_service_user_token = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.split_loggers         = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.timeout               = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.tls_ciphers           = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.tls_min_version       = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.verify_ssl            = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican.verify_ssl_path       = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican_service_user.auth_section = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican_service_user.auth_type = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican_service_user.cafile   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican_service_user.certfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican_service_user.collect_timing = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican_service_user.insecure = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican_service_user.keyfile  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican_service_user.split_loggers = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican_service_user.timeout  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican_service_user.tls_ciphers = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] barbican_service_user.tls_min_version = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] vault.approle_role_id          = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] vault.approle_secret_id        = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] vault.auth_method              = approle {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] vault.auth_path                = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] vault.kv_mountpoint            = secret {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] vault.kv_path                  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] vault.kv_version               = 2 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] vault.namespace                = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] vault.root_token_id            = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] vault.ssl_ca_crt_file          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] vault.timeout                  = 60.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] vault.token_file               = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] vault.token_role               = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] vault.use_ssl                  = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:56:52 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] ******************************************************************************** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 25 14:56:52 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root
Sep 25 14:56:52 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.452s {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:56:52 devstack cinder-volume[86430]: INFO cinder.volume.drivers.quobyte [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf succeeded
Sep 25 14:56:52 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=86430) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 14:56:52 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.465s {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:56:52 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:56:52 devstack sudo[86538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 14:56:52 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:56:53 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.264s {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:56:53 devstack cinder-volume[86430]: INFO cinder.volume.driver [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Driver hasn't implemented _init_vendor_properties()
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG cinder.volume.driver [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3550453186035, 'free_capacity_gb': 1775.3550453186035, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86430) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG oslo_db.sqlalchemy.engines [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86430) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG dbcounter [-] [86430] Writer thread running {{(pid=86430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG cinder.db.api [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Building query based on filter {{(pid=86430) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG cinder.image.image_utils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86430) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 25 14:56:53 devstack cinder-volume[86430]: INFO cinder.keymgr.migration [None req-cee31eb3-cd1c-4baa-ba8e-64f320a4e91d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=86430) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=86430) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:56:53 devstack sudo[86547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 14:56:53 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:56:53 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.267s {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG cinder.manager [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Notifying Schedulers of capabilities ... {{(pid=86430) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 14:56:53 devstack cinder-volume[86430]: INFO cinder.volume.manager [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Driver initialization completed successfully.
Sep 25 14:56:53 devstack cinder-volume[86430]: INFO cinder.manager [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Initiating service 3 cleanup
Sep 25 14:56:53 devstack cinder-volume[86430]: INFO cinder.manager [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Service 3 cleanup completed.
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG cinder.service [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Creating RPC server for service cinder-volume {{(pid=86430) start /opt/stack/cinder/cinder/service.py:231}}
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG cinder.service [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86430) start /opt/stack/cinder/cinder/service.py:237}}
Sep 25 14:56:53 devstack cinder-volume[86430]: INFO cinder.volume.manager [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=86430) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=86430) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:56:53 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:56:53 devstack sudo[86551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 14:56:53 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:56:54 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root
Sep 25 14:56:54 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.274s {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:56:54 devstack cinder-volume[86430]: INFO cinder.volume.manager [None req-8b28855b-4fcd-46cc-8184-83ca2abcde54 None None] Driver post RPC initialization completed successfully.
Sep 25 14:56:58 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-310e4f41-0aef-4b94-8f53-815a4cacb7ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:56:58 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-310e4f41-0aef-4b94-8f53-815a4cacb7ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:56:58 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-310e4f41-0aef-4b94-8f53-815a4cacb7ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=86430) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 14:56:58 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-310e4f41-0aef-4b94-8f53-815a4cacb7ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=86430) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 14:56:58 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-310e4f41-0aef-4b94-8f53-815a4cacb7ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:56:58 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-310e4f41-0aef-4b94-8f53-815a4cacb7ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:56:58 devstack sudo[86669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 14:56:58 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:56:58 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root
Sep 25 14:56:58 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-310e4f41-0aef-4b94-8f53-815a4cacb7ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.224s {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:56:58 devstack cinder-volume[86430]: DEBUG cinder.manager [None req-310e4f41-0aef-4b94-8f53-815a4cacb7ad None None] Notifying Schedulers of capabilities ... {{(pid=86430) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 14:57:01 devstack cinder-volume[86211]: INFO oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Caught SIGTERM, stopping children
Sep 25 14:57:01 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Acquiring lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 14:57:01 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Acquired lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 14:57:01 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Releasing lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 14:57:01 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Stop services. {{(pid=86211) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 25 14:57:01 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Killing children. {{(pid=86211) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 25 14:57:01 devstack cinder-volume[86211]: INFO oslo_service.backend._eventlet.service [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Waiting on 1 children to exit
Sep 25 14:57:04 devstack cinder-volume[86430]: DEBUG dbcounter [-] [86430] Writing DB stats cinder:SELECT=2 {{(pid=86430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 14:57:04 devstack cinder-volume[86430]: DEBUG dbcounter [-] [86430] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 14:57:06 devstack cinder-volume[86430]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Sep 25 14:57:06 devstack cinder-volume[86778]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 25 14:57:06 devstack cinder-volume[86778]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 25 14:57:06 devstack cinder-volume[86778]: we strongly recommend against using it for new projects.
Sep 25 14:57:06 devstack cinder-volume[86778]: If you are already using Eventlet, we recommend migrating to a different
Sep 25 14:57:06 devstack cinder-volume[86778]: framework.  For more detail see
Sep 25 14:57:06 devstack cinder-volume[86778]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 25 14:57:06 devstack cinder-volume[86778]:   import eventlet  # noqa
Sep 25 14:57:06 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Acquiring lock "singleton_lock" {{(pid=86430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 14:57:06 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Acquired lock "singleton_lock" {{(pid=86430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 14:57:06 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Releasing lock "singleton_lock" {{(pid=86430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 14:57:07 devstack cinder-volume[86430]: WARNING amqp [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 14:57:07 devstack cinder-volume[86430]: WARNING amqp [None req-f93ee60e-2d40-4b06-9e20-0611ff762faa None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 14:57:09 devstack cinder-volume[86778]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 14:57:09 devstack cinder-volume[86778]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 14:57:09 devstack cinder-volume[86778]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 14:57:09 devstack cinder-volume[86778]: INFO dbcounter [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] Registered counter for database cinder
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_db.sqlalchemy.engines [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86778) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG dbcounter [-] [86778] Writer thread running {{(pid=86778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 14:57:10 devstack cinder-volume[86778]: INFO cinder.rpc [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 25 14:57:10 devstack cinder-volume[86778]: INFO cinder.rpc [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_db.sqlalchemy.engines [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86778) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 14:57:10 devstack cinder-volume[86778]: INFO cinder.volume.manager [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] Determined volume DB was empty at startup.
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG cinder.volume.manager [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86778) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 25 14:57:10 devstack cinder-volume[86778]: WARNING stevedore.named [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 14:57:10 devstack cinder-volume[86778]: WARNING castellan.key_manager [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 14:57:10 devstack cinder-volume[86778]: WARNING cinder.keymgr.conf_key_mgr [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 14:57:10 devstack cinder-volume[86778]: INFO cinder.volume.manager [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_db.sqlalchemy.engines [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86778) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 14:57:10 devstack cinder-volume[86778]: INFO oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] Starting 1 workers
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] Started child 87071 {{(pid=86778) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] Full set of CONF: {{(pid=86778) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] ******************************************************************************** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] Configuration options gathered from: {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 25 14:57:10 devstack cinder-volume[87071]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] ================================================================================ {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] allow_availability_zone_fallback = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] allow_compression_on_image_upload = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] allowed_direct_url_schemes     = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] api_rate_limit                 = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] auth_strategy                  = keystone {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_availability_zone      = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_host                   = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_name                   = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_stats_polling_interval = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backup_api_class               = cinder.backup.api.API {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backup_name_template           = backup-%s {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backup_use_same_host           = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backup_use_temp_snapshot       = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] chap_password                  = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] chap_username                  =  {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cinder_internal_tenant_project_id = 8b92a884dc24458f90179d195e710c35 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cinder_internal_tenant_user_id = edff7a035a8a4dfaa068fed0244de23e {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cluster                        = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] compression_format             = gzip {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] config_dir                     = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] config_source                  = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] control_exchange               = openstack {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] debug                          = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] default_availability_zone      = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] default_group_type             = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] default_volume_type            = QuobyteHD {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] disk_geometry                  = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] driver_client_cert             = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] driver_client_cert_key         = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] driver_data_namespace          = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] driver_ssl_cert_path           = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] driver_ssl_cert_verify         = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] driver_use_ssl                 = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] enable_new_services            = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] enable_unsupported_driver      = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] enforce_multipath_for_image_xfer = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] filter_function                = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 25 14:57:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87071) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance_api_insecure            = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance_api_servers             = ['http://192.168.122.155/image'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance_api_ssl_compression     = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance_ca_certificates_file    = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance_certfile                = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance_keyfile                 = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance_num_retries             = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance_request_timeout         = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] goodness_function              = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] graceful_shutdown_timeout      = 5 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] group_api_class                = cinder.group.api.API {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] host                           = devstack {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] image_compress_on_upload       = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] image_conversion_address_space_limit = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] image_conversion_cpu_limit     = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] image_conversion_disable       = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] image_introspection_address_space_limit = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] image_introspection_cpu_limit  = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] image_upload_use_cinder_backend = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] image_upload_use_internal_tenant = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] image_volume_cache_enabled     = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] image_volume_cache_max_count   = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] image_volume_cache_max_size_gb = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] init_host_max_objects_retrieval = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] iscsi_target_flags             =  {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] iscsi_write_cache              = on {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] iser_helper                    = tgtadm {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] iser_ip_address                = 192.168.122.155 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] iser_port                      = 3260 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] log_color                      = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] log_config_append              = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] log_dir                        = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] log_file                       = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] log_options                    = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] log_rotate_interval            = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] log_rotate_interval_type       = days {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] log_rotation_type              = none {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] max_age                        = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] max_logfile_count              = 30 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] max_logfile_size_mb            = 200 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] max_over_subscription_ratio    = 20.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] message_reap_interval          = 86400 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] message_ttl                    = 2592000 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] migration_create_volume_timeout_secs = 300 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] monkey_patch                   = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] monkey_patch_modules           = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] my_ip                          = 192.168.122.155 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] no_snapshot_gb_quota           = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] num_iser_scan_tries            = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] num_shell_tries                = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] num_volume_device_scan_tries   = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] nvmeof_conn_info_version       = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] nvmet_ns_id                    = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] nvmet_port_id                  = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] osapi_max_limit                = 1000 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] osapi_volume_ext_list          = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] osapi_volume_listen_port       = 8776 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] osapi_volume_use_ssl           = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] osapi_volume_workers           = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] per_volume_size_limit          = -1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] periodic_fuzzy_delay           = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] periodic_interval              = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] public_endpoint                = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] publish_errors                 = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] quota_backup_gigabytes         = 1000 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] quota_backups                  = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] quota_gigabytes                = 1000 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] quota_groups                   = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] quota_snapshots                = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] quota_volumes                  = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] rate_limit_burst               = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] rate_limit_except_level        = CRITICAL {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] rate_limit_interval            = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] reinit_driver_count            = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] replication_device             = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87071) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 25 14:57:10 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.quobyte [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 25 14:57:10 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.quobyte [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 25 14:57:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Running cmd (subprocess): mount.quobyte {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] report_discard_supported       = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] report_interval                = 120 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] reservation_clean_interval     = 86400 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] reservation_expire             = 86400 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] reserved_image_namespaces      = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] reserved_percentage            = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] rpc_response_timeout           = 120 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] run_external_periodic_tasks    = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] scst_target_driver             = iscsi {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] scst_target_iqn_name           = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] service_down_time              = 720 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] shell_completion               = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] snapshot_name_template         = snapshot-%s {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] split_loggers                  = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] state_path                     = /opt/stack/data/cinder {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] storage_availability_zone      = nova {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] storage_protocol               = iSCSI {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] syslog_log_facility            = LOG_USER {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] target_helper                  = lioadm {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] target_ip_address              = 192.168.122.155 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] target_port                    = 3260 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] target_protocol                = iscsi {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] target_secondary_ip_addresses  = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] trace_flags                    = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] transport_url                  = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] until_refresh                  = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] use_chap_auth                  = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] use_default_quota_class        = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] use_journal                    = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] use_json                       = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] use_multipath_for_image_xfer   = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] use_stderr                     = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] use_syslog                     = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] verify_glance_signatures       = enabled {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] volume_api_class               = cinder.volume.api.API {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] volume_backend_name            = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] volume_clear                   = zero {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] volume_clear_ionice            = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] volume_clear_size              = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] volume_copy_bps_limit          = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] volume_dd_blocksize            = 1M {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] volume_name_template           = volume-%s {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] volume_service_inithost_offload = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] volume_usage_audit_period      = month {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] zoning_mode                    = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_concurrency.disable_process_locking = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.auth_section = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.auth_type   = password {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.auth_version = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.cache       = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.certfile    = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.include_service_catalog = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.insecure    = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.interface   = public {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.keyfile     = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcache_password = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack quobyte-client[87078]: Reading configuration file: /etc/quobyte/client.cfg
Sep 25 14:57:10 devstack quobyte-client[87078]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:57:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:57:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:57:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcache_username = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.region_name = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.service_type = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.155/identity {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.backend                  = dogpile.cache.null {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.backend_argument         = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.backend_expiration_time  = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.config_prefix            = cache.oslo {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:57:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.debug_cache_backend      = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.enable_retry_client      = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.enable_socket_keepalive  = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.enabled                  = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.expiration_time          = 600 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.hashclient_retry_attempts = 2 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.memcache_dead_retry      = 300 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.memcache_sasl_enabled    = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.password                 = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.proxies                  = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.redis_db                 = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.redis_server             = localhost:6379 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.retry_attempts           = 2 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.retry_delay              = 0.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.socket_keepalive_count   = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.socket_keepalive_idle    = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.socket_keepalive_interval = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.socket_timeout           = 1.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.tls_allowed_ciphers      = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.tls_cafile               = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.tls_certfile             = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.tls_enabled              = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.tls_keyfile              = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cache.username                 = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] coordination.backend_url       = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.asyncio_connection    = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.asyncio_slave_connection = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.backend               = sqlalchemy {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.connection            = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.connection_debug      = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.connection_parameters =  {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack sudo[87079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 14:57:10 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.connection_recycle_time = 3600 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.connection_trace      = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.db_inc_retry_interval = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.db_max_retries        = 20 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.db_max_retry_interval = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.db_retry_interval     = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.max_overflow          = 50 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.max_pool_size         = 5 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.max_retries           = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.mysql_wsrep_sync_wait = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.pool_timeout          = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.retry_interval        = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.slave_connection      = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.sqlite_synchronous    = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.synchronous_reader    = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] database.use_db_reconnect      = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_tracing.insecure = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] profiler.connection_string     = messaging:// {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] profiler.enabled               = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] profiler.es_doc_type           = notification {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] profiler.es_scroll_size        = 10000 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] profiler.es_scroll_time        = 2m {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] profiler.filter_error_trace    = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] profiler.hmac_keys             = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] profiler.sentinel_service_name = mymaster {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] profiler.socket_timeout        = 0.1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] profiler.trace_requests        = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] profiler.trace_sqlalchemy      = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] profiler_jaeger.process_tags   = {} {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] profiler_jaeger.service_name_prefix = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] profiler_otlp.service_name_prefix = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_policy.enforce_new_defaults = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_policy.policy_default_rule = default {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] privsep_osbrick.group          = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] privsep_osbrick.helper_command = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] privsep_osbrick.user           = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cinder_sys_admin.group         = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cinder_sys_admin.helper_command = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] cinder_sys_admin.user          = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] service_user.auth_section      = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] service_user.auth_type         = password {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] service_user.cafile            = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] service_user.certfile          = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] service_user.collect_timing    = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] service_user.insecure          = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] service_user.keyfile           = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] service_user.send_service_user_token = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] service_user.split_loggers     = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] service_user.timeout           = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] service_user.tls_ciphers       = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] service_user.tls_min_version   = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance.auth_section            = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance.auth_type               = password {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance.certfile                = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance.collect_timing          = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance.insecure                = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance.keyfile                 = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance.region_name             = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance.split_loggers           = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance.timeout                 = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance.tls_ciphers             = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] glance.tls_min_version         = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.backend_availability_zone = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.chap_password = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.chap_username =  {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.disk_geometry = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.driver_client_cert = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.driver_client_cert_key = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.driver_data_namespace = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.driver_use_ssl = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.extra_capabilities = {} {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.filter_function = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.goodness_function = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.iscsi_target_flags =  {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.iscsi_write_cache = on {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.iser_ip_address = 192.168.122.155 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.iser_port     = 3260 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.nas_host      =  {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.nas_login     = admin {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.nas_mount_options = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.nas_password  = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.nas_private_key =  {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.nas_share_path =  {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.num_shell_tries = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.quobyte_volume_url = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.replication_device = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.report_discard_supported = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.reserved_percentage = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.target_helper = tgtadm {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.target_ip_address = 192.168.122.155 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.target_port   = 3260 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.target_protocol = iscsi {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.trace_flags   = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.unique_fqdn_network = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.use_chap_auth = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.volume_backend_name = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.volume_clear  = zero {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.volume_clear_ionice = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.volume_clear_size = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_reports.file_event_handler = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_reports.log_dir           = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.backend_availability_zone = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.backend_host         = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.chap_password        = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.chap_username        = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.disk_geometry        = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.driver_client_cert   = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.driver_data_namespace = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.extra_capabilities   = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.filter_function      = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.goodness_function    = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.iser_helper          = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.iser_ip_address      = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.iser_port            = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.nas_host             = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.nas_login            = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.nas_mount_options    = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.nas_password         = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.nas_private_key      = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.nas_share_path       = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.num_shell_tries      = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.replication_device   = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.report_discard_supported = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.reserved_percentage  = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.scst_target_driver   = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.storage_protocol     = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.target_helper        = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.target_ip_address    = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.target_port          = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.target_prefix        = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.target_protocol      = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.trace_flags          = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.use_chap_auth        = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.volume_clear         = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.volume_clear_size    = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] QuobyteHD.volumes_dir          = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_notifications.driver = [] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_notifications.retry = -1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] key_manager.fixed_key          = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.barbican_api_version  = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.barbican_endpoint     = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.barbican_endpoint_type = public {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.barbican_region_name  = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.cafile                = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.certfile              = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.collect_timing        = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.insecure              = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.keyfile               = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.number_of_retries     = 60 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.retry_delay           = 1 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.send_service_user_token = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.split_loggers         = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.timeout               = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.tls_ciphers           = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.tls_min_version       = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.verify_ssl            = True {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican.verify_ssl_path       = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican_service_user.auth_section = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican_service_user.auth_type = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican_service_user.cafile   = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican_service_user.certfile = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican_service_user.collect_timing = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican_service_user.insecure = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican_service_user.keyfile  = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican_service_user.split_loggers = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican_service_user.timeout  = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican_service_user.tls_ciphers = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] barbican_service_user.tls_min_version = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] vault.approle_role_id          = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] vault.approle_secret_id        = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] vault.auth_method              = approle {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] vault.auth_path                = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] vault.kv_mountpoint            = secret {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] vault.kv_path                  = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] vault.kv_version               = 2 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] vault.namespace                = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] vault.root_token_id            = **** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] vault.ssl_ca_crt_file          = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] vault.timeout                  = 60.0 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] vault.token_file               = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] vault.token_role               = None {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] vault.use_ssl                  = False {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 14:57:10 devstack cinder-volume[86778]: DEBUG oslo_service.backend._eventlet.service [None req-c8299f20-eaf7-4c13-837b-1734d2f201b2 None None] ******************************************************************************** {{(pid=86778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 25 14:57:10 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root
Sep 25 14:57:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.257s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:57:10 devstack cinder-volume[87071]: INFO cinder.volume.driver [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Driver hasn't implemented _init_vendor_properties()
Sep 25 14:57:10 devstack cinder-volume[87071]: DEBUG cinder.volume.driver [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3550453186035, 'free_capacity_gb': 1775.3550453186035, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87071) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG oslo_db.sqlalchemy.engines [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87071) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writer thread running {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG cinder.db.api [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Building query based on filter {{(pid=87071) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87071) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:57:11 devstack cinder-volume[87071]: INFO cinder.keymgr.migration [None req-6c3bfa01-bb50-4b57-83dd-16ab7574faf6 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 25 14:57:11 devstack sudo[87093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 14:57:11 devstack sudo[87093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:57:11 devstack sudo[87093]: pam_unix(sudo:session): session closed for user root
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.236s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 14:57:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Driver initialization completed successfully.
Sep 25 14:57:11 devstack cinder-volume[87071]: INFO cinder.manager [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Initiating service 3 cleanup
Sep 25 14:57:11 devstack cinder-volume[87071]: INFO cinder.manager [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Service 3 cleanup completed.
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG cinder.service [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Creating RPC server for service cinder-volume {{(pid=87071) start /opt/stack/cinder/cinder/service.py:231}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG cinder.service [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87071) start /opt/stack/cinder/cinder/service.py:237}}
Sep 25 14:57:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:57:11 devstack sudo[87104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 14:57:11 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:57:11 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root
Sep 25 14:57:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.246s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:57:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6c1f83bc-3d2e-4bad-af83-6f616abb957c None None] Driver post RPC initialization completed successfully.
Sep 25 14:57:20 devstack cinder-volume[86778]: DEBUG dbcounter [-] [86778] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 14:57:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 14:57:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 6 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 14:57:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 14:57:21 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 14:57:21 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=4 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 14:58:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 14:58:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:58:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:58:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 14:58:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 14:58:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:58:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:58:20 devstack sudo[87601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 14:58:20 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:58:21 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root
Sep 25 14:58:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.534s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:58:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 14:58:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 14:58:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 6 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 14:58:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 14:58:34 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 14:58:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Flow 'volume_create_manager' (19185fd6-4425-4acb-81cb-c032a6bdca63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 14:58:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394af8cf-480c-4c36-a022-fdc35ecb2a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394af8cf-480c-4c36-a022-fdc35ecb2a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T12:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1645008776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166e0f4f-c67d-48fc-96de-b99a2da02d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72b740a7fef49f78ba47f89584e4673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:58:34Z,use_quota=True,user_id='ca5678b02eb349a5a14574ee6f2399f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be34df5e-99ae-46e7-a89d-a6d7a6e674ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be34df5e-99ae-46e7-a89d-a6d7a6e674ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb18a31f-fb4b-4759-bae5-0a7e941a27c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb18a31f-fb4b-4759-bae5-0a7e941a27c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '166e0f4f-c67d-48fc-96de-b99a2da02d9d', 'volume_name': 'volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bec9f06-43db-4887-bcc4-2fe769f16d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bec9f06-43db-4887-bcc4-2fe769f16d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf80c5e-ebce-4c97-98fc-37860dad6d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:58:35 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Volume 166e0f4f-c67d-48fc-96de-b99a2da02d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d', 'volume_size': 1}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T12:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1645008776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166e0f4f-c67d-48fc-96de-b99a2da02d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72b740a7fef49f78ba47f89584e4673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:58:34Z,use_quota=True,user_id='ca5678b02eb349a5a14574ee6f2399f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Creating volume 166e0f4f-c67d-48fc-96de-b99a2da02d9d {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 14:58:35 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 14:58:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:58:35 devstack sudo[87884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d 1073741824
Sep 25 14:58:35 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:58:36 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root
Sep 25 14:58:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d 1073741824" returned: 0 in 1.512s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:58:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:58:37 devstack sudo[88207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d
Sep 25 14:58:37 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:58:37 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root
Sep 25 14:58:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d" returned: 0 in 0.803s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:58:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] <== create_volume: return (2483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 14:58:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.493s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:58:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf80c5e-ebce-4c97-98fc-37860dad6d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:58:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f93c3765-9825-4ad1-aaea-dad28a280fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:58:37 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Volume volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d (166e0f4f-c67d-48fc-96de-b99a2da02d9d): created successfully
Sep 25 14:58:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f93c3765-9825-4ad1-aaea-dad28a280fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:58:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Flow 'volume_create_manager' (19185fd6-4425-4acb-81cb-c032a6bdca63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 14:58:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2da8a6f8-db8a-4d09-a0f9-ab473480bf0b tempest-DeleteServersTestJSON-537983496 None] Created volume successfully.
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Flow 'volume_create_manager' (aa2fde42-5e68-451a-9d65-5163639daf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad7c5f3-d553-4208-8946-52d04d039682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad7c5f3-d553-4208-8946-52d04d039682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T12:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1455340293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ce96f8-2173-47bd-aff6-107b37d680e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3603c6e3627a4306aa14481be7a3ea81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:58:40Z,use_quota=True,user_id='199b47fa7da04d85ad42410af84f45a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a68f5d5-b11d-4024-a6de-6bada71433a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a68f5d5-b11d-4024-a6de-6bada71433a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a437b600-f2fc-49cc-98cc-833acd07d201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a437b600-f2fc-49cc-98cc-833acd07d201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53ce96f8-2173-47bd-aff6-107b37d680e8', 'volume_name': 'volume-53ce96f8-2173-47bd-aff6-107b37d680e8', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc25c136-8c8f-4557-ae94-bee9d4615aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc25c136-8c8f-4557-ae94-bee9d4615aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f2de10-23ec-4015-af92-8dcebf022fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:58:40 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Volume 53ce96f8-2173-47bd-aff6-107b37d680e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53ce96f8-2173-47bd-aff6-107b37d680e8', 'volume_size': 1}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T12:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1455340293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ce96f8-2173-47bd-aff6-107b37d680e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3603c6e3627a4306aa14481be7a3ea81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:58:40Z,use_quota=True,user_id='199b47fa7da04d85ad42410af84f45a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Creating volume 53ce96f8-2173-47bd-aff6-107b37d680e8 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 14:58:40 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 14:58:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53ce96f8-2173-47bd-aff6-107b37d680e8 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:58:40 devstack sudo[88217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53ce96f8-2173-47bd-aff6-107b37d680e8 1073741824
Sep 25 14:58:40 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:58:41 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root
Sep 25 14:58:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53ce96f8-2173-47bd-aff6-107b37d680e8 1073741824" returned: 0 in 1.022s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:58:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53ce96f8-2173-47bd-aff6-107b37d680e8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:58:41 devstack sudo[88227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53ce96f8-2173-47bd-aff6-107b37d680e8
Sep 25 14:58:41 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:58:42 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root
Sep 25 14:58:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53ce96f8-2173-47bd-aff6-107b37d680e8" returned: 0 in 0.604s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:58:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 14:58:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:58:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f2de10-23ec-4015-af92-8dcebf022fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53ce96f8-2173-47bd-aff6-107b37d680e8', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:58:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (506f3f40-1772-4085-8d98-ccd6a6df9831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:58:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Volume volume-53ce96f8-2173-47bd-aff6-107b37d680e8 (53ce96f8-2173-47bd-aff6-107b37d680e8): created successfully
Sep 25 14:58:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (506f3f40-1772-4085-8d98-ccd6a6df9831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:58:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Flow 'volume_create_manager' (aa2fde42-5e68-451a-9d65-5163639daf42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 14:58:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c994a44d-56df-4be2-8dbe-558626839592 tempest-VolumesAdminNegativeTest-1428135906 None] Created volume successfully.
Sep 25 14:58:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Acquiring lock "cinder-53ce96f8-2173-47bd-aff6-107b37d680e8-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 14:58:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Lock "cinder-53ce96f8-2173-47bd-aff6-107b37d680e8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 14:58:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Acquiring lock "cinder-quobyte-53ce96f8-2173-47bd-aff6-107b37d680e8" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 14:58:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Lock "cinder-quobyte-53ce96f8-2173-47bd-aff6-107b37d680e8" acquired by "delete_volume" :: waited 0.046s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 14:58:44 devstack cinder-volume[87071]: INFO oslo.privsep.daemon [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp60g3wqg3/privsep.sock']
Sep 25 14:58:44 devstack sudo[88244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp60g3wqg3/privsep.sock
Sep 25 14:58:44 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:58:45 devstack cinder-volume[87071]: WARNING py.warnings [req-e67ffc16-6708-48bc-8b3b-4c47523bf143 req-084c673c-7823-4e44-b7e1-1de6b54f4930 tempest-DeleteServersTestJSON-537983496 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Sep 25 14:58:45 devstack cinder-volume[87071]:   .first()
Sep 25 14:58:45 devstack cinder-volume[87071]: 
Sep 25 14:58:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-e67ffc16-6708-48bc-8b3b-4c47523bf143 req-084c673c-7823-4e44-b7e1-1de6b54f4930 tempest-DeleteServersTestJSON-537983496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:58:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-e67ffc16-6708-48bc-8b3b-4c47523bf143 req-084c673c-7823-4e44-b7e1-1de6b54f4930 tempest-DeleteServersTestJSON-537983496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:58:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-e67ffc16-6708-48bc-8b3b-4c47523bf143 req-084c673c-7823-4e44-b7e1-1de6b54f4930 tempest-DeleteServersTestJSON-537983496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:58:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-e67ffc16-6708-48bc-8b3b-4c47523bf143 req-084c673c-7823-4e44-b7e1-1de6b54f4930 tempest-DeleteServersTestJSON-537983496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f471d9b0-d6f6-4beb-9f0c-a375a000d059', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 14:58:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-e67ffc16-6708-48bc-8b3b-4c47523bf143 req-084c673c-7823-4e44-b7e1-1de6b54f4930 tempest-DeleteServersTestJSON-537983496 None] attachment_update completed successfully.
Sep 25 14:58:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 25 14:58:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 25 14:58:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 25 14:58:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 25 14:58:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 25 14:58:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 25 14:58:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 25 14:58:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 25 14:58:46 devstack cinder-volume[87071]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 25 14:58:46 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root
Sep 25 14:58:46 devstack cinder-volume[87071]: INFO oslo.privsep.daemon [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Spawned new privsep daemon via rootwrap
Sep 25 14:58:46 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Accepted privsep connection to /tmp/tmp60g3wqg3/privsep.sock {{(pid=87071) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 25 14:58:46 devstack cinder-volume[87071]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 25 14:58:46 devstack cinder-volume[87071]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 25 14:58:46 devstack cinder-volume[87071]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 25 14:58:46 devstack cinder-volume[87071]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88380
Sep 25 14:58:46 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a57d09e-7103-44e7-8193-1aec692a5241]: (2,) {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 14:58:47 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c240cec-ac68-42dd-8859-109b80f0f8c8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 14:58:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53ce96f8-2173-47bd-aff6-107b37d680e8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:58:47 devstack sudo[88701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53ce96f8-2173-47bd-aff6-107b37d680e8
Sep 25 14:58:47 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:58:48 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root
Sep 25 14:58:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53ce96f8-2173-47bd-aff6-107b37d680e8" returned: 0 in 1.006s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:58:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53ce96f8-2173-47bd-aff6-107b37d680e8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:58:48 devstack sudo[88730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53ce96f8-2173-47bd-aff6-107b37d680e8
Sep 25 14:58:48 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:58:48 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root
Sep 25 14:58:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53ce96f8-2173-47bd-aff6-107b37d680e8" returned: 0 in 0.777s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:58:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Lock "cinder-quobyte-53ce96f8-2173-47bd-aff6-107b37d680e8" released by "delete_volume" :: held 4.052s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 14:58:48 devstack cinder-volume[87071]: WARNING cinder.quota [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 25 14:58:48 devstack cinder-volume[87071]: WARNING cinder.quota [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 25 14:58:49 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Created reservations ['307c6244-2fd0-4c64-8f23-cf4ace3fc9a6', '311f24d3-8156-4f78-a1eb-4e596786e296', '1679c665-82bc-4fdd-83d6-709d7617b15d', '24203ffa-5c04-43a3-9f0d-0db62f39551d'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 14:58:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:58:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:58:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 14:58:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 14:58:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:58:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:58:49 devstack sudo[88736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 14:58:49 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:58:50 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root
Sep 25 14:58:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.868s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:58:50 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 14:58:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Deleted volume successfully.
Sep 25 14:58:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-81dbca49-2f22-48da-84eb-c4bb9dfb2534 tempest-VolumesAdminNegativeTest-1428135906 None] Lock "cinder-53ce96f8-2173-47bd-aff6-107b37d680e8-delete_volume" released by "delete_volume" :: held 5.637s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 14:58:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-de6f2234-5d63-43c0-be5b-95e30fc2c85b req-8120e3c6-6dac-4988-acae-0a98bcb2e7d6 tempest-DeleteServersTestJSON-537983496 None] Terminate volume connection completed successfully.
Sep 25 14:58:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-de6f2234-5d63-43c0-be5b-95e30fc2c85b req-8120e3c6-6dac-4988-acae-0a98bcb2e7d6 tempest-DeleteServersTestJSON-537983496 None] Deleting attachment f471d9b0-d6f6-4beb-9f0c-a375a000d059. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 14:58:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Acquiring lock "cinder-166e0f4f-c67d-48fc-96de-b99a2da02d9d-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 14:58:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Lock "cinder-166e0f4f-c67d-48fc-96de-b99a2da02d9d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 14:58:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Acquiring lock "cinder-quobyte-166e0f4f-c67d-48fc-96de-b99a2da02d9d" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 14:58:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Lock "cinder-quobyte-166e0f4f-c67d-48fc-96de-b99a2da02d9d" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 14:58:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7297bdbb-63f6-4171-85a4-38c4bfb408eb]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 14:58:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:58:54 devstack sudo[88831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d
Sep 25 14:58:54 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:58:54 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root
Sep 25 14:58:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d" returned: 0 in 0.501s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:58:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:58:54 devstack sudo[88837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d
Sep 25 14:58:54 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:58:54 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root
Sep 25 14:58:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-166e0f4f-c67d-48fc-96de-b99a2da02d9d" returned: 0 in 0.322s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:58:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Lock "cinder-quobyte-166e0f4f-c67d-48fc-96de-b99a2da02d9d" released by "delete_volume" :: held 0.882s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 14:58:54 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Created reservations ['80f3edec-12d6-4e22-ba54-9723f18fe89c', 'f7423eb8-4095-43c5-aaf7-1360d15a1129', '79e41a36-ee64-4e8b-9dd0-972a4365874f', '33e82b6b-ed11-44bf-8a85-bdf66e6221a3'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 14:58:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:58:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:58:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 14:58:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 14:58:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:58:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:58:55 devstack sudo[88841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 14:58:55 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:58:55 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root
Sep 25 14:58:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.431s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:58:55 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 14:58:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Deleted volume successfully.
Sep 25 14:58:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e82c9dde-451a-4590-9205-26bb46391d8b tempest-DeleteServersTestJSON-537983496 None] Lock "cinder-166e0f4f-c67d-48fc-96de-b99a2da02d9d-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Flow 'volume_create_manager' (c4620228-46a6-422e-ae24-73c0755b5d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ec0f223-ed7d-4a06-8e70-419d45277a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ec0f223-ed7d-4a06-8e70-419d45277a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T12:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-399099343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b270da-66d5-405b-a2a4-d3c74b1d7e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c792c1a0f10f4f41963ddbe511b14129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:59:04Z,use_quota=True,user_id='accaf25e8fa54fe1a2d85b26019507ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b722881-3dca-4ac4-b5d7-5409fa5313a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b722881-3dca-4ac4-b5d7-5409fa5313a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7365367-b8af-43b3-975b-50c6375c8603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7365367-b8af-43b3-975b-50c6375c8603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5b270da-66d5-405b-a2a4-d3c74b1d7e96', 'volume_name': 'volume-d5b270da-66d5-405b-a2a4-d3c74b1d7e96', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f5de36-c89d-4583-8559-9355ec05a582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f5de36-c89d-4583-8559-9355ec05a582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506e1359-97ea-46e2-b035-3d09282b71e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:59:03 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Volume d5b270da-66d5-405b-a2a4-d3c74b1d7e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5b270da-66d5-405b-a2a4-d3c74b1d7e96', 'volume_size': 1}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T12:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-399099343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b270da-66d5-405b-a2a4-d3c74b1d7e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c792c1a0f10f4f41963ddbe511b14129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:59:04Z,use_quota=True,user_id='accaf25e8fa54fe1a2d85b26019507ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Creating volume d5b270da-66d5-405b-a2a4-d3c74b1d7e96 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 14:59:03 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 14:59:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d5b270da-66d5-405b-a2a4-d3c74b1d7e96 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:59:03 devstack sudo[88850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d5b270da-66d5-405b-a2a4-d3c74b1d7e96 1073741824
Sep 25 14:59:03 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:59:04 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root
Sep 25 14:59:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d5b270da-66d5-405b-a2a4-d3c74b1d7e96 1073741824" returned: 0 in 0.603s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:59:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d5b270da-66d5-405b-a2a4-d3c74b1d7e96 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:59:04 devstack sudo[88857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d5b270da-66d5-405b-a2a4-d3c74b1d7e96
Sep 25 14:59:04 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:59:04 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root
Sep 25 14:59:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d5b270da-66d5-405b-a2a4-d3c74b1d7e96" returned: 0 in 0.358s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:59:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 14:59:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:59:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506e1359-97ea-46e2-b035-3d09282b71e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5b270da-66d5-405b-a2a4-d3c74b1d7e96', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:59:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d3e19d-f44a-451b-81a3-4ce6a385cefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:59:04 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Volume volume-d5b270da-66d5-405b-a2a4-d3c74b1d7e96 (d5b270da-66d5-405b-a2a4-d3c74b1d7e96): created successfully
Sep 25 14:59:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d3e19d-f44a-451b-81a3-4ce6a385cefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:59:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Flow 'volume_create_manager' (c4620228-46a6-422e-ae24-73c0755b5d07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 14:59:04 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-13cfd514-bc7a-4937-87f3-4a83cd66d9ac tempest-AttachVolumeShelveTestJSON-1209405917 None] Created volume successfully.
Sep 25 14:59:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 14:59:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:59:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:59:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 14:59:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 14:59:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:59:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:59:20 devstack sudo[88900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 14:59:20 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:59:21 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root
Sep 25 14:59:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.282s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:59:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 14:59:21 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=18,cinder:UPDATE=35,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 14:59:21 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=30,cinder:UPDATE=19,cinder:DELETE=3,cinder:INSERT=3 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Flow 'volume_create_manager' (a572dedd-7147-4b8d-b4b4-3e5eeb060d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94aecc9e-5e60-467e-8970-b56b96dc4fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94aecc9e-5e60-467e-8970-b56b96dc4fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T12:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-377108979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9edc68-9f58-4ab6-83b6-46424dee1627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ebd4c673c94b2eabcdf5ee6a5a8c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:59:32Z,use_quota=True,user_id='1f28f9791a454d1c9085ca0946bd5969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f089ee27-25a4-4bf2-a9e3-e15094e51171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f089ee27-25a4-4bf2-a9e3-e15094e51171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07838cb6-6bc0-40c4-b2ee-90b2c1380205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07838cb6-6bc0-40c4-b2ee-90b2c1380205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af9edc68-9f58-4ab6-83b6-46424dee1627', 'volume_name': 'volume-af9edc68-9f58-4ab6-83b6-46424dee1627', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac2feab-bb24-4858-806f-d6a545afdc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac2feab-bb24-4858-806f-d6a545afdc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73372844-54f8-4667-b918-e595db2f959d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:59:31 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Volume af9edc68-9f58-4ab6-83b6-46424dee1627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af9edc68-9f58-4ab6-83b6-46424dee1627', 'volume_size': 1}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T12:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-377108979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9edc68-9f58-4ab6-83b6-46424dee1627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ebd4c673c94b2eabcdf5ee6a5a8c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T12:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T12:59:32Z,use_quota=True,user_id='1f28f9791a454d1c9085ca0946bd5969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Creating volume af9edc68-9f58-4ab6-83b6-46424dee1627 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 14:59:31 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 14:59:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-af9edc68-9f58-4ab6-83b6-46424dee1627 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:59:31 devstack sudo[88908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-af9edc68-9f58-4ab6-83b6-46424dee1627 1073741824
Sep 25 14:59:31 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:59:32 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root
Sep 25 14:59:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-af9edc68-9f58-4ab6-83b6-46424dee1627 1073741824" returned: 0 in 0.623s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:59:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-af9edc68-9f58-4ab6-83b6-46424dee1627 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 14:59:32 devstack sudo[88914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-af9edc68-9f58-4ab6-83b6-46424dee1627
Sep 25 14:59:32 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 14:59:33 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root
Sep 25 14:59:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-af9edc68-9f58-4ab6-83b6-46424dee1627" returned: 0 in 0.421s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 14:59:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 14:59:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 14:59:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73372844-54f8-4667-b918-e595db2f959d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af9edc68-9f58-4ab6-83b6-46424dee1627', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:59:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a852b505-1119-4ae5-89d4-119e3cd79aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 14:59:33 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Volume volume-af9edc68-9f58-4ab6-83b6-46424dee1627 (af9edc68-9f58-4ab6-83b6-46424dee1627): created successfully
Sep 25 14:59:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a852b505-1119-4ae5-89d4-119e3cd79aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 14:59:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Flow 'volume_create_manager' (a572dedd-7147-4b8d-b4b4-3e5eeb060d20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 14:59:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-783d644d-ea32-496d-ba53-7f14fcf8df03 tempest-TaggedAttachmentsTest-1722800693 None] Created volume successfully.
Sep 25 14:59:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-aab8ff65-b7bb-44fb-b462-456ca8ae986b req-a4c42f31-78b5-4865-854a-4c43fdfb7c13 tempest-AttachVolumeShelveTestJSON-1209405917 None] No connector for attachment 6b815e27-183a-4cc4-9ead-6bf2aac45c1a; skipping storage backend terminate_connection call. {{(pid=87071) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 25 14:59:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-aab8ff65-b7bb-44fb-b462-456ca8ae986b req-a4c42f31-78b5-4865-854a-4c43fdfb7c13 tempest-AttachVolumeShelveTestJSON-1209405917 None] Deleting attachment 6b815e27-183a-4cc4-9ead-6bf2aac45c1a. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 14:59:46 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 14:59:46 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:00:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:00:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:00:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:00:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:00:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:00:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:00:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:00:20 devstack sudo[89503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:00:20 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:00:21 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root
Sep 25 15:00:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.297s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:00:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:00:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:00:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 8 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:00:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Flow 'volume_create_manager' (664e1a90-9d13-4f27-9fda-85055fc11bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4c4ad5-a648-48c9-9fa8-01c1901e3d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a4c4ad5-a648-48c9-9fa8-01c1901e3d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1556721749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9283cba2b2f142ba89d8ea6b62ed2164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:00:27Z,use_quota=True,user_id='3b0ca287775d4be7996517992b0ba0cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51347d0e-1206-4cce-afd5-6caa75352694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51347d0e-1206-4cce-afd5-6caa75352694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ffdb14-98b5-4805-8fa3-2f0667a917e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ffdb14-98b5-4805-8fa3-2f0667a917e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0', 'volume_name': 'volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9014bb4a-fcaa-4eec-a187-44c194f976e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9014bb4a-fcaa-4eec-a187-44c194f976e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3fe74c-ad9a-4756-a3c3-4ad2ff1ba393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:00:27 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Volume 3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0', 'volume_size': 1}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1556721749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9283cba2b2f142ba89d8ea6b62ed2164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:00:27Z,use_quota=True,user_id='3b0ca287775d4be7996517992b0ba0cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Creating volume 3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:00:27 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:00:27 devstack sudo[89539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0 1073741824
Sep 25 15:00:27 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:00:27 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root
Sep 25 15:00:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0 1073741824" returned: 0 in 0.617s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:00:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:00:28 devstack sudo[89545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0
Sep 25 15:00:28 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:00:28 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root
Sep 25 15:00:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0" returned: 0 in 0.288s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:00:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:00:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:00:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3fe74c-ad9a-4756-a3c3-4ad2ff1ba393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:00:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba97e7c-712d-46ae-bc8c-12b0a160653c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:00:28 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Volume volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0 (3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0): created successfully
Sep 25 15:00:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba97e7c-712d-46ae-bc8c-12b0a160653c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:00:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Flow 'volume_create_manager' (664e1a90-9d13-4f27-9fda-85055fc11bc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:00:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-13f845f2-fa3b-4590-8814-15a56bf5e413 tempest-AttachVolumeNegativeTest-862497125 None] Created volume successfully.
Sep 25 15:00:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-1e923ee0-4ca8-4cfc-bf10-46dfb76c573b req-aaae7e2b-4f8a-41c6-a727-7435c9c4b051 tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:00:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-1e923ee0-4ca8-4cfc-bf10-46dfb76c573b req-aaae7e2b-4f8a-41c6-a727-7435c9c4b051 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:00:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-1e923ee0-4ca8-4cfc-bf10-46dfb76c573b req-aaae7e2b-4f8a-41c6-a727-7435c9c4b051 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:00:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1e923ee0-4ca8-4cfc-bf10-46dfb76c573b req-aaae7e2b-4f8a-41c6-a727-7435c9c4b051 tempest-AttachVolumeNegativeTest-862497125 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ced59d5c-3aef-4e81-a4a1-7d6dfe501fa8', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:00:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-1e923ee0-4ca8-4cfc-bf10-46dfb76c573b req-aaae7e2b-4f8a-41c6-a727-7435c9c4b051 tempest-AttachVolumeNegativeTest-862497125 None] attachment_update completed successfully.
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Flow 'volume_create_manager' (ba3de3b3-2320-4ee7-b54f-1f1037bbdb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52ab60e-7047-4648-8976-bae03bc42f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52ab60e-7047-4648-8976-bae03bc42f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-345788905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4d6027-639e-4e39-bd73-631d08192848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e3f5ce1dfb4fd2a8c0102dfd302d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:00:40Z,use_quota=True,user_id='b41dcdab90af424aa81a84eeceda3871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b46b3c5-208c-4bed-a52d-6d0ec1b9552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b46b3c5-208c-4bed-a52d-6d0ec1b9552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90409692-2752-413d-b847-f90af28e4090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90409692-2752-413d-b847-f90af28e4090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c4d6027-639e-4e39-bd73-631d08192848', 'volume_name': 'volume-0c4d6027-639e-4e39-bd73-631d08192848', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01559290-1cce-4898-8b35-86982be9abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01559290-1cce-4898-8b35-86982be9abc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75da559b-907a-4bb2-8dab-43a90a105d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:00:40 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Volume 0c4d6027-639e-4e39-bd73-631d08192848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c4d6027-639e-4e39-bd73-631d08192848', 'volume_size': 1}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-345788905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4d6027-639e-4e39-bd73-631d08192848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e3f5ce1dfb4fd2a8c0102dfd302d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:00:40Z,use_quota=True,user_id='b41dcdab90af424aa81a84eeceda3871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Creating volume 0c4d6027-639e-4e39-bd73-631d08192848 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:00:40 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:00:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c4d6027-639e-4e39-bd73-631d08192848 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:00:40 devstack sudo[90038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c4d6027-639e-4e39-bd73-631d08192848 1073741824
Sep 25 15:00:40 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:00:41 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root
Sep 25 15:00:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c4d6027-639e-4e39-bd73-631d08192848 1073741824" returned: 0 in 0.666s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:00:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c4d6027-639e-4e39-bd73-631d08192848 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:00:41 devstack sudo[90047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c4d6027-639e-4e39-bd73-631d08192848
Sep 25 15:00:41 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:00:41 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root
Sep 25 15:00:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c4d6027-639e-4e39-bd73-631d08192848" returned: 0 in 0.311s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:00:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:00:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:00:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75da559b-907a-4bb2-8dab-43a90a105d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c4d6027-639e-4e39-bd73-631d08192848', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:00:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d900f04-f98e-45fc-a4dd-a316761e9f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:00:41 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Volume volume-0c4d6027-639e-4e39-bd73-631d08192848 (0c4d6027-639e-4e39-bd73-631d08192848): created successfully
Sep 25 15:00:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d900f04-f98e-45fc-a4dd-a316761e9f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:00:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Flow 'volume_create_manager' (ba3de3b3-2320-4ee7-b54f-1f1037bbdb28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:00:41 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5fe31649-eeeb-4d71-9f88-78edb9cbc33c tempest-ServerActionsTestOtherA-1077220928 None] Created volume successfully.
Sep 25 15:00:51 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=10,cinder:SELECT=9,cinder:INSERT=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:00:51 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=12,cinder:UPDATE=5,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:00:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Acquiring lock "cinder-d5b270da-66d5-405b-a2a4-d3c74b1d7e96-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:00:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Lock "cinder-d5b270da-66d5-405b-a2a4-d3c74b1d7e96-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:00:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Acquiring lock "cinder-quobyte-d5b270da-66d5-405b-a2a4-d3c74b1d7e96" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:00:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Lock "cinder-quobyte-d5b270da-66d5-405b-a2a4-d3c74b1d7e96" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:00:55 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[461e631d-4758-4552-8335-f1e1161be048]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:00:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d5b270da-66d5-405b-a2a4-d3c74b1d7e96 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:00:55 devstack sudo[90336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d5b270da-66d5-405b-a2a4-d3c74b1d7e96
Sep 25 15:00:55 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:00:55 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root
Sep 25 15:00:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d5b270da-66d5-405b-a2a4-d3c74b1d7e96" returned: 0 in 0.912s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:00:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d5b270da-66d5-405b-a2a4-d3c74b1d7e96 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:00:56 devstack sudo[90363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d5b270da-66d5-405b-a2a4-d3c74b1d7e96
Sep 25 15:00:56 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:00:56 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root
Sep 25 15:00:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d5b270da-66d5-405b-a2a4-d3c74b1d7e96" returned: 0 in 0.718s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:00:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Lock "cinder-quobyte-d5b270da-66d5-405b-a2a4-d3c74b1d7e96" released by "delete_volume" :: held 1.782s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:00:56 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Created reservations ['9d864cd7-49fe-41da-ac8d-2b55c2642c79', 'f9fb5203-85e4-4947-a016-42e52b7388b4', '5d722495-7f47-43be-a704-6cf903383c2e', 'c151cde8-3bb8-450e-ba55-57f948c3a28b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:00:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:00:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:00:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:00:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:00:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:00:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:00:57 devstack sudo[90377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:00:57 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:00:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-d1a44107-d407-4115-b5df-bd6fd58b5732 req-93ab6cce-7c63-4721-8740-fd8a85b12d35 tempest-TaggedAttachmentsTest-1722800693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:00:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-d1a44107-d407-4115-b5df-bd6fd58b5732 req-93ab6cce-7c63-4721-8740-fd8a85b12d35 tempest-TaggedAttachmentsTest-1722800693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:00:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-d1a44107-d407-4115-b5df-bd6fd58b5732 req-93ab6cce-7c63-4721-8740-fd8a85b12d35 tempest-TaggedAttachmentsTest-1722800693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:00:57 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root
Sep 25 15:00:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-d1a44107-d407-4115-b5df-bd6fd58b5732 req-93ab6cce-7c63-4721-8740-fd8a85b12d35 tempest-TaggedAttachmentsTest-1722800693 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-af9edc68-9f58-4ab6-83b6-46424dee1627', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '034cba8e-2d71-4e50-8ca6-fc3d65759d91', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:00:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.455s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:00:57 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:00:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Deleted volume successfully.
Sep 25 15:00:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-53a2ea00-2343-479b-b7ab-85f40983d304 tempest-AttachVolumeShelveTestJSON-1209405917 None] Lock "cinder-d5b270da-66d5-405b-a2a4-d3c74b1d7e96-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:00:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-d1a44107-d407-4115-b5df-bd6fd58b5732 req-93ab6cce-7c63-4721-8740-fd8a85b12d35 tempest-TaggedAttachmentsTest-1722800693 None] attachment_update completed successfully.
Sep 25 15:01:02 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-5649ccd8-6b28-40dd-8e82-b67204c54863 req-ce781f1a-9efc-4285-93f7-3ea06a9f311b tempest-TaggedAttachmentsTest-1722800693 None] Terminate volume connection completed successfully.
Sep 25 15:01:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5649ccd8-6b28-40dd-8e82-b67204c54863 req-ce781f1a-9efc-4285-93f7-3ea06a9f311b tempest-TaggedAttachmentsTest-1722800693 None] Deleting attachment 034cba8e-2d71-4e50-8ca6-fc3d65759d91. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:01:19 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-ad12e6e7-7919-4b58-bbe9-1b10f2bd34e7 req-476679a6-1f9e-440e-9d14-7ee43d88a539 tempest-AttachVolumeNegativeTest-862497125 None] Terminate volume connection completed successfully.
Sep 25 15:01:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-ad12e6e7-7919-4b58-bbe9-1b10f2bd34e7 req-476679a6-1f9e-440e-9d14-7ee43d88a539 tempest-AttachVolumeNegativeTest-862497125 None] Deleting attachment ced59d5c-3aef-4e81-a4a1-7d6dfe501fa8. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:01:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Acquiring lock "cinder-af9edc68-9f58-4ab6-83b6-46424dee1627-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:01:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Lock "cinder-af9edc68-9f58-4ab6-83b6-46424dee1627-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:01:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Acquiring lock "cinder-quobyte-af9edc68-9f58-4ab6-83b6-46424dee1627" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:01:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Lock "cinder-quobyte-af9edc68-9f58-4ab6-83b6-46424dee1627" acquired by "delete_volume" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:01:20 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc71b01-61f1-45b5-b3b6-aa4709989f38]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:01:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-af9edc68-9f58-4ab6-83b6-46424dee1627 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:01:20 devstack sudo[90613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-af9edc68-9f58-4ab6-83b6-46424dee1627
Sep 25 15:01:20 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:01:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:01:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:01:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:01:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:01:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:01:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:01:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:01:20 devstack sudo[90616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:01:20 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:01:21 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root
Sep 25 15:01:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-af9edc68-9f58-4ab6-83b6-46424dee1627" returned: 0 in 0.787s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:01:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-af9edc68-9f58-4ab6-83b6-46424dee1627 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:01:21 devstack sudo[90622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-af9edc68-9f58-4ab6-83b6-46424dee1627
Sep 25 15:01:21 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:01:21 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root
Sep 25 15:01:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.451s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:01:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:01:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:01:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 8 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:01:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:01:21 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root
Sep 25 15:01:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-af9edc68-9f58-4ab6-83b6-46424dee1627" returned: 0 in 0.675s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:01:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Lock "cinder-quobyte-af9edc68-9f58-4ab6-83b6-46424dee1627" released by "delete_volume" :: held 1.562s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:01:21 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Created reservations ['3704937f-761f-4160-9945-5026110489df', '2a505c40-5103-4c9a-b1e0-d1ff8616754d', 'fc24235d-22b4-4b4e-a4af-ae71bffdaa6c', '301c7499-6d6c-44c5-9576-5ca5d943ce6c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:01:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:01:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:01:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:01:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:01:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:01:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:01:22 devstack sudo[90648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:01:22 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:01:22 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root
Sep 25 15:01:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.340s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:01:22 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:01:22 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Deleted volume successfully.
Sep 25 15:01:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7c3df131-08e7-46c9-980e-d43ca0260f77 tempest-TaggedAttachmentsTest-1722800693 None] Lock "cinder-af9edc68-9f58-4ab6-83b6-46424dee1627-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:01:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-b8d2f69d-e094-4355-adf7-83aafb32a418 req-a0a6f002-3518-4304-b337-6fafd8bc9a8b tempest-ServerActionsTestOtherA-1077220928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:01:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-b8d2f69d-e094-4355-adf7-83aafb32a418 req-a0a6f002-3518-4304-b337-6fafd8bc9a8b tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:01:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-b8d2f69d-e094-4355-adf7-83aafb32a418 req-a0a6f002-3518-4304-b337-6fafd8bc9a8b tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:01:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-b8d2f69d-e094-4355-adf7-83aafb32a418 req-a0a6f002-3518-4304-b337-6fafd8bc9a8b tempest-ServerActionsTestOtherA-1077220928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-0c4d6027-639e-4e39-bd73-631d08192848', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ce3638c-999e-4e1d-a4d6-0f9ab28b178f', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:01:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-b8d2f69d-e094-4355-adf7-83aafb32a418 req-a0a6f002-3518-4304-b337-6fafd8bc9a8b tempest-ServerActionsTestOtherA-1077220928 None] attachment_update completed successfully.
Sep 25 15:01:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-8185099d-b24c-4904-aab3-4d4b07f06fd9 req-bba0be5a-003f-48bd-a231-0a8adf139854 tempest-ServerActionsTestOtherA-1077220928 None] Terminate volume connection completed successfully.
Sep 25 15:01:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-8185099d-b24c-4904-aab3-4d4b07f06fd9 req-bba0be5a-003f-48bd-a231-0a8adf139854 tempest-ServerActionsTestOtherA-1077220928 None] Deleting attachment 7ce3638c-999e-4e1d-a4d6-0f9ab28b178f. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:01:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-8185099d-b24c-4904-aab3-4d4b07f06fd9 req-0700b8e0-0b1a-4903-b80b-493972fd63c7 tempest-ServerActionsTestOtherA-1077220928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:01:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-8185099d-b24c-4904-aab3-4d4b07f06fd9 req-0700b8e0-0b1a-4903-b80b-493972fd63c7 tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:01:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-8185099d-b24c-4904-aab3-4d4b07f06fd9 req-0700b8e0-0b1a-4903-b80b-493972fd63c7 tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:01:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-8185099d-b24c-4904-aab3-4d4b07f06fd9 req-0700b8e0-0b1a-4903-b80b-493972fd63c7 tempest-ServerActionsTestOtherA-1077220928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-0c4d6027-639e-4e39-bd73-631d08192848', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '362606a6-738f-410e-98d1-0ebf954f701c', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:01:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-8185099d-b24c-4904-aab3-4d4b07f06fd9 req-0700b8e0-0b1a-4903-b80b-493972fd63c7 tempest-ServerActionsTestOtherA-1077220928 None] attachment_update completed successfully.
Sep 25 15:01:44 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=35,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:01:44 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=31,cinder:INSERT=4,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:01:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b24c1424-3ff7-46fa-b4d8-b10ab4ed2660 tempest-BackendsCapabilitiesAdminTestsJSON-679444747 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3550453186035, 'free_capacity_gb': 1775.3550453186035, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87071) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 25 15:01:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-84120e79-b0f5-4b30-81a7-71e0e487d071 tempest-BackendsCapabilitiesAdminTestsJSON-679444747 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3550453186035, 'free_capacity_gb': 1775.3550453186035, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87071) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 25 15:02:02 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8ac00b5b-831e-43b1-b33e-214888f960bf tempest-GroupsV320Test-761813083 None] Group tempest-GroupsV320Test-Group-1362001430: creating
Sep 25 15:02:02 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8ac00b5b-831e-43b1-b33e-214888f960bf tempest-GroupsV320Test-761813083 None] Group tempest-GroupsV320Test-Group-1362001430: created successfully
Sep 25 15:02:02 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8ac00b5b-831e-43b1-b33e-214888f960bf tempest-GroupsV320Test-761813083 None] Create group completed successfully.
Sep 25 15:02:04 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-28c23bd6-8f96-4747-9fd5-803bd90f4894 tempest-GroupsV320Test-761813083 None] Created reservations ['af4b7769-52fc-4978-9513-1d89ddd2f758'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:02:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-28c23bd6-8f96-4747-9fd5-803bd90f4894 tempest-GroupsV320Test-761813083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-28c23bd6-8f96-4747-9fd5-803bd90f4894 tempest-GroupsV320Test-761813083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-28c23bd6-8f96-4747-9fd5-803bd90f4894 tempest-GroupsV320Test-761813083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:02:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-28c23bd6-8f96-4747-9fd5-803bd90f4894 tempest-GroupsV320Test-761813083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:02:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-28c23bd6-8f96-4747-9fd5-803bd90f4894 tempest-GroupsV320Test-761813083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28c23bd6-8f96-4747-9fd5-803bd90f4894 tempest-GroupsV320Test-761813083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:05 devstack sudo[91977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:02:05 devstack sudo[91977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:05 devstack sudo[91977]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28c23bd6-8f96-4747-9fd5-803bd90f4894 tempest-GroupsV320Test-761813083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.313s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:05 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-28c23bd6-8f96-4747-9fd5-803bd90f4894 tempest-GroupsV320Test-761813083 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:02:05 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-28c23bd6-8f96-4747-9fd5-803bd90f4894 tempest-GroupsV320Test-761813083 None] Delete group completed successfully.
Sep 25 15:02:10 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-2c8c31a4-114e-4fe0-a0b6-74b557b63e19 req-9c9ff704-125f-4be4-afbd-2bd0d8fe1860 tempest-ServerActionsTestOtherA-1077220928 None] Terminate volume connection completed successfully.
Sep 25 15:02:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-2c8c31a4-114e-4fe0-a0b6-74b557b63e19 req-9c9ff704-125f-4be4-afbd-2bd0d8fe1860 tempest-ServerActionsTestOtherA-1077220928 None] Deleting attachment 362606a6-738f-410e-98d1-0ebf954f701c. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Flow 'volume_create_manager' (8679c192-9dbd-4366-94c2-67eafc26132c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f9b1eb-8230-4659-b75d-c094123e6103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f9b1eb-8230-4659-b75d-c094123e6103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-611669480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969381dd-6c5d-4059-bbc5-5b68c02b3aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ec8002b3b34f94a174925dd4ad085c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:02:14Z,use_quota=True,user_id='ab61d19c2f784b23b56ade739f5cd9f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e709e90b-cdd6-43d4-a32e-d22e54be8e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e709e90b-cdd6-43d4-a32e-d22e54be8e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3a6b05-b733-444d-89c4-1ace97e0eb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3a6b05-b733-444d-89c4-1ace97e0eb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '969381dd-6c5d-4059-bbc5-5b68c02b3aaf', 'volume_name': 'volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8226d892-80b5-4359-8251-18e2fc4dfea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8226d892-80b5-4359-8251-18e2fc4dfea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2379bdf8-7f02-4434-8309-1c86ea98dc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:14 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Volume 969381dd-6c5d-4059-bbc5-5b68c02b3aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf', 'volume_size': 1}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-611669480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969381dd-6c5d-4059-bbc5-5b68c02b3aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ec8002b3b34f94a174925dd4ad085c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:02:14Z,use_quota=True,user_id='ab61d19c2f784b23b56ade739f5cd9f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Creating volume 969381dd-6c5d-4059-bbc5-5b68c02b3aaf {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:02:14 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:02:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:14 devstack sudo[92077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf 1073741824
Sep 25 15:02:14 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:15 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf 1073741824" returned: 0 in 0.602s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:15 devstack sudo[92084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf
Sep 25 15:02:15 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:15 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf" returned: 0 in 0.294s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:02:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2379bdf8-7f02-4434-8309-1c86ea98dc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77732bd0-1290-4902-a109-724aa422517c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Volume volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf (969381dd-6c5d-4059-bbc5-5b68c02b3aaf): created successfully
Sep 25 15:02:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77732bd0-1290-4902-a109-724aa422517c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Flow 'volume_create_manager' (8679c192-9dbd-4366-94c2-67eafc26132c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:02:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c216248a-0499-4e7e-b130-1f3a0a253e80 tempest-AttachVolumeTestJSON-497406096 None] Created volume successfully.
Sep 25 15:02:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-452981be-073c-4669-a228-2dd023f413c0 req-a675164b-6ae6-4d60-865b-c6e4c7288df5 tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-452981be-073c-4669-a228-2dd023f413c0 req-a675164b-6ae6-4d60-865b-c6e4c7288df5 tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-452981be-073c-4669-a228-2dd023f413c0 req-a675164b-6ae6-4d60-865b-c6e4c7288df5 tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-452981be-073c-4669-a228-2dd023f413c0 req-a675164b-6ae6-4d60-865b-c6e4c7288df5 tempest-AttachVolumeTestJSON-497406096 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '879be962-4b63-4e60-b77f-7d733370969a', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:02:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-452981be-073c-4669-a228-2dd023f413c0 req-a675164b-6ae6-4d60-865b-c6e4c7288df5 tempest-AttachVolumeTestJSON-497406096 None] attachment_update completed successfully.
Sep 25 15:02:19 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:02:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Flow 'volume_create_manager' (871aac8a-9ed3-49b9-be07-7fc662380455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:02:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d68f4a-ae7f-472d-954c-6601133f8642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d68f4a-ae7f-472d-954c-6601133f8642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1825447296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b960870-528f-4766-89f5-b2b292cb9980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e3f5ce1dfb4fd2a8c0102dfd302d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:02:19Z,use_quota=True,user_id='b41dcdab90af424aa81a84eeceda3871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22e211a-578f-459f-ad69-c011b528fc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22e211a-578f-459f-ad69-c011b528fc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53302a8-66c1-4776-a55b-8b983b14055b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:19 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53302a8-66c1-4776-a55b-8b983b14055b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b960870-528f-4766-89f5-b2b292cb9980', 'volume_name': 'volume-0b960870-528f-4766-89f5-b2b292cb9980', 'volume_size': 1, 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd97dcba93bf843d9acf4a870a4730210', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'created_at': datetime.datetime(2026, 9, 25, 12, 52, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 52, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a354fa4c-98b3-48a7-8483-e976ebf152bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x763826017c80>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea0d06d-78d4-4480-be14-f41f0737d2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea0d06d-78d4-4480-be14-f41f0737d2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93b353f-2663-4d71-8d2a-6ad335dce26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:20 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Volume 0b960870-528f-4766-89f5-b2b292cb9980: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b960870-528f-4766-89f5-b2b292cb9980', 'volume_size': 1, 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd97dcba93bf843d9acf4a870a4730210', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'created_at': datetime.datetime(2026, 9, 25, 12, 52, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 52, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a354fa4c-98b3-48a7-8483-e976ebf152bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x763826017c80>}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Trying to clone 0b960870-528f-4766-89f5-b2b292cb9980 from image a354fa4c-98b3-48a7-8483-e976ebf152bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Flow 'volume_create_manager' (24079b39-2825-4d78-b3d1-d62c683dc749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ec18cd-0025-4c16-b733-e62be6a15c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:20 devstack sudo[92549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:02:20 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ec18cd-0025-4c16-b733-e62be6a15c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1323640434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d0b761-e039-4e7f-a134-4fa4a90b3ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9283cba2b2f142ba89d8ea6b62ed2164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:02:21Z,use_quota=True,user_id='3b0ca287775d4be7996517992b0ba0cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a08d5a3-a49e-469e-9545-a3a2c7781ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a08d5a3-a49e-469e-9545-a3a2c7781ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5fc3727-d199-45b5-b2d8-90a7821c99eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5fc3727-d199-45b5-b2d8-90a7821c99eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d0b761-e039-4e7f-a134-4fa4a90b3ec0', 'volume_name': 'volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33bb4266-887f-40ed-9fbd-c873d6dfe92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33bb4266-887f-40ed-9fbd-c873d6dfe92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f12beca-493d-4cb0-b78d-900ab7278dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:20 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Volume c2d0b761-e039-4e7f-a134-4fa4a90b3ec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0', 'volume_size': 1}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1323640434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d0b761-e039-4e7f-a134-4fa4a90b3ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9283cba2b2f142ba89d8ea6b62ed2164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:02:21Z,use_quota=True,user_id='3b0ca287775d4be7996517992b0ba0cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Creating volume c2d0b761-e039-4e7f-a134-4fa4a90b3ec0 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:02:20 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:20 devstack sudo[92551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0 1073741824
Sep 25 15:02:20 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:20 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_15r5xuxjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 15:02:20 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 15:02:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a152cdc-1837-407b-bb4e-493294a44c10]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:02:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_15r5xuxjdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:21 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.298s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:02:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:02:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:02:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:02:21 devstack sudo[92553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_15r5xuxjdevstack@QuobyteHD
Sep 25 15:02:21 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:21 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_15r5xuxjdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:21 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Temporary image a354fa4c-98b3-48a7-8483-e976ebf152bc is fetched for user b41dcdab90af424aa81a84eeceda3871. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 15:02:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dfed1f-dd53-4dfe-96be-8202e8668776]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:02:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_15r5xuxjdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:21 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0 1073741824" returned: 0 in 0.749s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:21 devstack sudo[92563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_15r5xuxjdevstack@QuobyteHD
Sep 25 15:02:21 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:21 devstack sudo[92564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0
Sep 25 15:02:21 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:22 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_15r5xuxjdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:22 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0" returned: 0 in 0.409s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.099s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1825447296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b960870-528f-4766-89f5-b2b292cb9980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e3f5ce1dfb4fd2a8c0102dfd302d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:02:19Z,use_quota=True,user_id='b41dcdab90af424aa81a84eeceda3871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Creating volume 0b960870-528f-4766-89f5-b2b292cb9980 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:02:22 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:22 devstack sudo[92572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980 1073741824
Sep 25 15:02:22 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f12beca-493d-4cb0-b78d-900ab7278dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42946079-ab33-4f63-bdd5-166a820fc4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:22 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Volume volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0 (c2d0b761-e039-4e7f-a134-4fa4a90b3ec0): created successfully
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42946079-ab33-4f63-bdd5-166a820fc4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Flow 'volume_create_manager' (24079b39-2825-4d78-b3d1-d62c683dc749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:02:22 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0aae14e4-6c5b-4e3e-9ad1-6b12b74cea55 tempest-AttachVolumeNegativeTest-862497125 None] Created volume successfully.
Sep 25 15:02:22 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980 1073741824" returned: 0 in 0.674s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:22 devstack sudo[92585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980
Sep 25 15:02:22 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:23 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980" returned: 0 in 0.650s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:02:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:23 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Attempting download of a354fa4c-98b3-48a7-8483-e976ebf152bc ((None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}])) to volume 0b960870-528f-4766-89f5-b2b292cb9980. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 15:02:23 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cf5676-470a-4093-af14-c90497d221f9]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:02:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_g529887n {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:23 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:02:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Flow 'volume_create_manager' (d4fb9315-3b4e-4ac3-aa43-e087dc773684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:02:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385067a2-f7cb-49aa-a5ef-521a6e375e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385067a2-f7cb-49aa-a5ef-521a6e375e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1427643231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5de59f3-bdbc-410a-922c-51db39c828bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12c05b4799541d8abdbfa4aad8a4c2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:02:24Z,use_quota=True,user_id='3bf5168fe22e4bccbe90a4390c532f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3510af32-feb7-4272-8a23-22b9418b7eee),volume_type_id=3510af32-feb7-4272-8a23-22b9418b7eee)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9faa8b6c-dbfd-4063-a5b6-18448780ca91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9faa8b6c-dbfd-4063-a5b6-18448780ca91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e5ede7-d93e-4fb5-a60b-e02f83bcc13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e5ede7-d93e-4fb5-a60b-e02f83bcc13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5de59f3-bdbc-410a-922c-51db39c828bf', 'volume_name': 'volume-b5de59f3-bdbc-410a-922c-51db39c828bf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:23 devstack sudo[92724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_g529887n
Sep 25 15:02:23 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c758281a-0a82-47e5-9a70-95d0a8ae6562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c758281a-0a82-47e5-9a70-95d0a8ae6562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd62105-f540-4e15-806b-b21e88bcea5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:24 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Volume b5de59f3-bdbc-410a-922c-51db39c828bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5de59f3-bdbc-410a-922c-51db39c828bf', 'volume_size': 1}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1427643231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5de59f3-bdbc-410a-922c-51db39c828bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12c05b4799541d8abdbfa4aad8a4c2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:02:24Z,use_quota=True,user_id='3bf5168fe22e4bccbe90a4390c532f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3510af32-feb7-4272-8a23-22b9418b7eee),volume_type_id=3510af32-feb7-4272-8a23-22b9418b7eee)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Creating volume b5de59f3-bdbc-410a-922c-51db39c828bf {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:02:24 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5de59f3-bdbc-410a-922c-51db39c828bf 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:24 devstack sudo[92729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5de59f3-bdbc-410a-922c-51db39c828bf 1073741824
Sep 25 15:02:24 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:24 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_g529887n" returned: 0 in 0.469s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_g529887n {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-b5c4bbd7-b3c6-4f8d-8363-f73b9b3755ed req-aa789109-12d6-41f7-a7f1-bc3001e4ec52 tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:24 devstack sudo[92744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_g529887n
Sep 25 15:02:24 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:24 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_g529887n" returned: 1 in 0.380s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_g529887n' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecd2bf9-b4bf-4078-abc9-978e399bf12a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_15r5xuxjdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:24 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5de59f3-bdbc-410a-922c-51db39c828bf 1073741824" returned: 0 in 0.617s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5de59f3-bdbc-410a-922c-51db39c828bf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:24 devstack sudo[92763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5de59f3-bdbc-410a-922c-51db39c828bf
Sep 25 15:02:24 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:24 devstack sudo[92760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_15r5xuxjdevstack@QuobyteHD
Sep 25 15:02:24 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:25 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5de59f3-bdbc-410a-922c-51db39c828bf" returned: 0 in 0.441s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:02:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-b5c4bbd7-b3c6-4f8d-8363-f73b9b3755ed req-aa789109-12d6-41f7-a7f1-bc3001e4ec52 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.847s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd62105-f540-4e15-806b-b21e88bcea5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5de59f3-bdbc-410a-922c-51db39c828bf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9968daed-c600-4910-80bc-d6077351adbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-b5c4bbd7-b3c6-4f8d-8363-f73b9b3755ed req-aa789109-12d6-41f7-a7f1-bc3001e4ec52 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:25 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Volume volume-b5de59f3-bdbc-410a-922c-51db39c828bf (b5de59f3-bdbc-410a-922c-51db39c828bf): created successfully
Sep 25 15:02:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9968daed-c600-4910-80bc-d6077351adbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Flow 'volume_create_manager' (d4fb9315-3b4e-4ac3-aa43-e087dc773684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:02:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-38f0b9f9-16fe-43ef-ae4d-f681743eb6fb tempest-VolumeTypesAccessTest-1334863238 None] Created volume successfully.
Sep 25 15:02:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-b5c4bbd7-b3c6-4f8d-8363-f73b9b3755ed req-aa789109-12d6-41f7-a7f1-bc3001e4ec52 tempest-AttachVolumeNegativeTest-862497125 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff473f9a-957a-4e4b-80c5-bcfd211d2f8f', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:02:25 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_15r5xuxjdevstack@QuobyteHD" returned: 0 in 0.770s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:25 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] a354fa4c-98b3-48a7-8483-e976ebf152bc was qcow2, converting to qcow2 {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 15:02:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_15r5xuxjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:25 devstack sudo[93120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_15r5xuxjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980
Sep 25 15:02:25 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-b5c4bbd7-b3c6-4f8d-8363-f73b9b3755ed req-aa789109-12d6-41f7-a7f1-bc3001e4ec52 tempest-AttachVolumeNegativeTest-862497125 None] attachment_update completed successfully.
Sep 25 15:02:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Acquiring lock "cinder-b5de59f3-bdbc-410a-922c-51db39c828bf-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:02:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Lock "cinder-b5de59f3-bdbc-410a-922c-51db39c828bf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:02:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Acquiring lock "cinder-quobyte-b5de59f3-bdbc-410a-922c-51db39c828bf" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:02:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Lock "cinder-quobyte-b5de59f3-bdbc-410a-922c-51db39c828bf" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:02:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be5949f-6e6f-4abc-8dec-ccc2bacc89b7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:02:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5de59f3-bdbc-410a-922c-51db39c828bf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:26 devstack sudo[93152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5de59f3-bdbc-410a-922c-51db39c828bf
Sep 25 15:02:26 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:26 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5de59f3-bdbc-410a-922c-51db39c828bf" returned: 0 in 0.733s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5de59f3-bdbc-410a-922c-51db39c828bf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:26 devstack sudo[93170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5de59f3-bdbc-410a-922c-51db39c828bf
Sep 25 15:02:26 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5de59f3-bdbc-410a-922c-51db39c828bf" returned: 0 in 0.400s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:27 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Lock "cinder-quobyte-b5de59f3-bdbc-410a-922c-51db39c828bf" released by "delete_volume" :: held 1.200s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:02:27 devstack cinder-volume[87071]: WARNING cinder.quota [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1653555932 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1653555932, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:02:27 devstack cinder-volume[87071]: WARNING cinder.quota [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1653555932 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1653555932, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:02:27 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Created reservations ['0d190b0a-821c-430a-808f-e1e5cbc74e99', '283b6ad3-34c2-4e0d-9f12-ae35a4bcd60d', '600e87c6-5080-42e1-9027-cb35b256e509', '2c54852d-5d8c-47dd-991b-d915d029e7b0'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:02:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:02:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:02:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:27 devstack sudo[93189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:02:27 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:28 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.396s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:28 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:02:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Deleted volume successfully.
Sep 25 15:02:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fafda926-446e-4a1a-bf14-98abbec22981 tempest-VolumeTypesAccessTest-1334863238 None] Lock "cinder-b5de59f3-bdbc-410a-922c-51db39c828bf-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:02:28 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_15r5xuxjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980" returned: 0 in 3.135s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:28 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_15r5xuxjdevstack@QuobyteHD, size 112.00 MB, duration 3.14 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:02:28 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Converted 112.00 MB image at 35.70 MB/s
Sep 25 15:02:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:28 devstack sudo[93197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980 1G
Sep 25 15:02:28 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-6f52441b-f72d-41f7-898a-b08a4777d189 req-0fdd1625-8b1e-452d-8873-93e02147e986 tempest-AttachVolumeNegativeTest-862497125 None] Terminate volume connection completed successfully.
Sep 25 15:02:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-6f52441b-f72d-41f7-898a-b08a4777d189 req-0fdd1625-8b1e-452d-8873-93e02147e986 tempest-AttachVolumeNegativeTest-862497125 None] Deleting attachment ff473f9a-957a-4e4b-80c5-bcfd211d2f8f. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:02:29 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980 1G" returned: 0 in 0.670s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:29 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Downloaded image a354fa4c-98b3-48a7-8483-e976ebf152bc ((None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}])) to volume 0b960870-528f-4766-89f5-b2b292cb9980 successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 15:02:29 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Temporary image a354fa4c-98b3-48a7-8483-e976ebf152bc for user b41dcdab90af424aa81a84eeceda3871 is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 15:02:29 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Marking volume 0b960870-528f-4766-89f5-b2b292cb9980 as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 15:02:29 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Copying metadata from image a354fa4c-98b3-48a7-8483-e976ebf152bc to 0b960870-528f-4766-89f5-b2b292cb9980. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 15:02:29 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Creating volume glance metadata for volume 0b960870-528f-4766-89f5-b2b292cb9980 backed by image a354fa4c-98b3-48a7-8483-e976ebf152bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 15:02:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93b353f-2663-4d71-8d2a-6ad335dce26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b960870-528f-4766-89f5-b2b292cb9980', 'volume_size': 1, 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd97dcba93bf843d9acf4a870a4730210', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'created_at': datetime.datetime(2026, 9, 25, 12, 52, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 52, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a354fa4c-98b3-48a7-8483-e976ebf152bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x763826017c80>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92979980-2aae-445e-b291-dbf9b3b49721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:29 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Volume volume-0b960870-528f-4766-89f5-b2b292cb9980 (0b960870-528f-4766-89f5-b2b292cb9980): created successfully
Sep 25 15:02:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92979980-2aae-445e-b291-dbf9b3b49721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Flow 'volume_create_manager' (871aac8a-9ed3-49b9-be07-7fc662380455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:02:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-91bd05ef-55aa-42c0-b80b-64f222554eaf tempest-ServerActionsTestOtherA-1077220928 None] Created volume successfully.
Sep 25 15:02:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-475a0f66-43bc-452c-b1ae-c7ba50f20063 req-6b26f241-6a78-4e80-87fb-609810d127a7 tempest-ServerActionsTestOtherA-1077220928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-475a0f66-43bc-452c-b1ae-c7ba50f20063 req-6b26f241-6a78-4e80-87fb-609810d127a7 tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-475a0f66-43bc-452c-b1ae-c7ba50f20063 req-6b26f241-6a78-4e80-87fb-609810d127a7 tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-475a0f66-43bc-452c-b1ae-c7ba50f20063 req-6b26f241-6a78-4e80-87fb-609810d127a7 tempest-ServerActionsTestOtherA-1077220928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-0b960870-528f-4766-89f5-b2b292cb9980', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0ad3f1e-9b24-44ec-93da-dcfb74470d43', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:02:35 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-475a0f66-43bc-452c-b1ae-c7ba50f20063 req-6b26f241-6a78-4e80-87fb-609810d127a7 tempest-ServerActionsTestOtherA-1077220928 None] attachment_update completed successfully.
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Flow 'volume_create_manager' (972072ce-5303-499f-ae2c-13c24dc2df81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc84ab4-1f16-4650-854b-dd6eb85cabd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc84ab4-1f16-4650-854b-dd6eb85cabd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1520418421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83315ae0-95f4-410b-a060-bc9143a4d986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a489474d29433287dbbe923991a2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:02:43Z,use_quota=True,user_id='defffa34b45648f7beb30eb5e3d10093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3704b68c-d934-4f7e-9da2-d6a0f8b9a0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3704b68c-d934-4f7e-9da2-d6a0f8b9a0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27b61d2-cc60-4cc3-95df-f015bdd51f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27b61d2-cc60-4cc3-95df-f015bdd51f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83315ae0-95f4-410b-a060-bc9143a4d986', 'volume_name': 'volume-83315ae0-95f4-410b-a060-bc9143a4d986', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5a2cc5-d85d-402d-a59a-567d5d8b0f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5a2cc5-d85d-402d-a59a-567d5d8b0f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0be9f94-4c9f-4e53-9612-2cd0c87bf72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Volume 83315ae0-95f4-410b-a060-bc9143a4d986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83315ae0-95f4-410b-a060-bc9143a4d986', 'volume_size': 1}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1520418421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83315ae0-95f4-410b-a060-bc9143a4d986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a489474d29433287dbbe923991a2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:02:43Z,use_quota=True,user_id='defffa34b45648f7beb30eb5e3d10093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Creating volume 83315ae0-95f4-410b-a060-bc9143a4d986 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:02:42 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:02:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:42 devstack sudo[93294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986 1073741824
Sep 25 15:02:42 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:43 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986 1073741824" returned: 0 in 0.761s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:43 devstack sudo[93357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986
Sep 25 15:02:43 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:44 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986" returned: 0 in 0.484s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:02:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0be9f94-4c9f-4e53-9612-2cd0c87bf72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83315ae0-95f4-410b-a060-bc9143a4d986', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664162d4-1dbb-4415-a544-2f686074f598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:02:44 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Volume volume-83315ae0-95f4-410b-a060-bc9143a4d986 (83315ae0-95f4-410b-a060-bc9143a4d986): created successfully
Sep 25 15:02:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664162d4-1dbb-4415-a544-2f686074f598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:02:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Flow 'volume_create_manager' (972072ce-5303-499f-ae2c-13c24dc2df81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:02:44 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6296f1c4-8ae3-4448-bdfc-6cf5b5506165 tempest-SnapshotMetadataTestJSON-246453279 None] Created volume successfully.
Sep 25 15:02:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] Creating offline snapshot f88ea092-ddc9-42ec-92c0-781b983af05a of volume 83315ae0-95f4-410b-a060-bc9143a4d986 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:02:45 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0474b3b-f514-429e-bd94-5652b1b7add5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:02:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:45 devstack sudo[93362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986
Sep 25 15:02:45 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:45 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986" returned: 0 in 0.637s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:45 devstack sudo[93370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a 1G
Sep 25 15:02:45 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:46 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a 1G" returned: 0 in 0.773s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83315ae0-95f4-410b-a060-bc9143a4d986 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:46 devstack sudo[93376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83315ae0-95f4-410b-a060-bc9143a4d986 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a
Sep 25 15:02:46 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:47 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83315ae0-95f4-410b-a060-bc9143a4d986 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a" returned: 0 in 0.506s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:47 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a is being set with open permissions: ugo+rw
Sep 25 15:02:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:47 devstack sudo[93383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a
Sep 25 15:02:47 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:47 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a" returned: 0 in 0.494s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:47 devstack sudo[93387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.info
Sep 25 15:02:47 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:48 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.info" returned: 0 in 0.624s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:48 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.info is being set with open permissions: ugo+rw
Sep 25 15:02:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:48 devstack sudo[93391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.info
Sep 25 15:02:48 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:49 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.info" returned: 0 in 0.761s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a81db783-1ac0-44b5-9896-1b173c4c16fb tempest-SnapshotMetadataTestJSON-246453279 None] Create snapshot completed successfully
Sep 25 15:02:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Acquiring lock "cinder-f88ea092-ddc9-42ec-92c0-781b983af05a-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:02:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Lock "cinder-f88ea092-ddc9-42ec-92c0-781b983af05a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:02:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Acquiring lock "cinder-quobyte-83315ae0-95f4-410b-a060-bc9143a4d986" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:02:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Lock "cinder-quobyte-83315ae0-95f4-410b-a060-bc9143a4d986" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:02:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Acquiring lock "cinder-quobyte-f88ea092-ddc9-42ec-92c0-781b983af05a" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:02:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Lock "cinder-quobyte-f88ea092-ddc9-42ec-92c0-781b983af05a" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:02:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Deleting offline snapshot f88ea092-ddc9-42ec-92c0-781b983af05a of volume 83315ae0-95f4-410b-a060-bc9143a4d986 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:02:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] snapshot_file for this snap is: volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:02:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec3d2bb-fd45-4bb3-83f4-6b01b6ee2e44]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:02:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:52 devstack sudo[93446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a
Sep 25 15:02:52 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:52 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a" returned: 0 in 1.165s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83315ae0-95f4-410b-a060-bc9143a4d986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:02:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c053ee9-237a-4749-8882-75e4ddfc8bcb]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:02:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:53 devstack sudo[93459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986
Sep 25 15:02:53 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:54 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986" returned: 0 in 1.005s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:54 devstack sudo[93479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a
Sep 25 15:02:54 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-337019fd-4790-427a-af6d-170fc11db7db req-cdd53458-a0fe-49fe-927d-447ec10c00fe tempest-AttachVolumeTestJSON-497406096 None] Terminate volume connection completed successfully.
Sep 25 15:02:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-337019fd-4790-427a-af6d-170fc11db7db req-cdd53458-a0fe-49fe-927d-447ec10c00fe tempest-AttachVolumeTestJSON-497406096 None] Deleting attachment 879be962-4b63-4e60-b77f-7d733370969a. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:02:54 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a" returned: 0 in 0.774s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:54 devstack sudo[93484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a
Sep 25 15:02:54 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:55 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986.f88ea092-ddc9-42ec-92c0-781b983af05a" returned: 0 in 0.906s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:55 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=60,cinder:UPDATE=28,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:02:55 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=40,cinder:SELECT=52,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:02:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Lock "cinder-quobyte-f88ea092-ddc9-42ec-92c0-781b983af05a" released by "_delete_snapshot" :: held 4.216s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:02:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Lock "cinder-quobyte-83315ae0-95f4-410b-a060-bc9143a4d986" released by "delete_snapshot" :: held 4.307s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:02:56 devstack cinder-volume[87071]: WARNING cinder.quota [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:02:56 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Created reservations ['26b94dff-d936-4d73-8ac5-e701290b2ac6', 'e0454974-7e07-400d-8da1-170294ae4e1b', 'bf6462f6-d154-4941-840f-6c9f7fc7bf46', 'cc230a6f-85f2-4e9e-a798-12b9dcab1751'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:02:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Delete snapshot completed successfully.
Sep 25 15:02:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-98b5d3fb-b682-4436-bd6b-d2cd0192b1c2 tempest-SnapshotMetadataTestJSON-246453279 None] Lock "cinder-f88ea092-ddc9-42ec-92c0-781b983af05a-delete_snapshot" released by "delete_snapshot" :: held 4.797s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:02:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Acquiring lock "cinder-83315ae0-95f4-410b-a060-bc9143a4d986-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:02:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Lock "cinder-83315ae0-95f4-410b-a060-bc9143a4d986-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:02:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Acquiring lock "cinder-quobyte-83315ae0-95f4-410b-a060-bc9143a4d986" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:02:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Lock "cinder-quobyte-83315ae0-95f4-410b-a060-bc9143a4d986" acquired by "delete_volume" :: waited 0.051s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:02:57 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7637d7-13e4-4a72-9543-c748e428f3ec]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:02:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:58 devstack sudo[93564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986
Sep 25 15:02:58 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:58 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986" returned: 0 in 0.671s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:58 devstack sudo[93584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986
Sep 25 15:02:58 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:59 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-83315ae0-95f4-410b-a060-bc9143a4d986" returned: 0 in 0.534s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Lock "cinder-quobyte-83315ae0-95f4-410b-a060-bc9143a4d986" released by "delete_volume" :: held 1.369s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:02:59 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Created reservations ['676f7311-4013-4c84-943f-bc841ef9097c', 'e5591585-f946-48f3-a750-cf46b9c362cf', '6971726b-e393-4afa-aef5-0084ec4d73ea', 'a3e20584-ce39-4b40-b8a5-b08c7ac28dbd'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:02:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:02:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:02:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:02:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:02:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:02:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:02:59 devstack sudo[93590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:02:59 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:02:59 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root
Sep 25 15:02:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.525s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:02:59 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:02:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Deleted volume successfully.
Sep 25 15:03:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9d2038ab-2f3d-4449-a57b-7866b63e0638 tempest-SnapshotMetadataTestJSON-246453279 None] Lock "cinder-83315ae0-95f4-410b-a060-bc9143a4d986-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:03:01 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-0dcc7c53-8f4d-4ed0-be23-c3ea13d21724 req-7ff2031d-2c17-4ca4-bf86-b5a15cb94024 tempest-ServerActionsTestOtherA-1077220928 None] Terminate volume connection completed successfully.
Sep 25 15:03:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-0dcc7c53-8f4d-4ed0-be23-c3ea13d21724 req-7ff2031d-2c17-4ca4-bf86-b5a15cb94024 tempest-ServerActionsTestOtherA-1077220928 None] Deleting attachment b0ad3f1e-9b24-44ec-93da-dcfb74470d43. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:03:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-0dcc7c53-8f4d-4ed0-be23-c3ea13d21724 req-9a47df47-eaf5-40d3-bb59-ca93742e85ee tempest-ServerActionsTestOtherA-1077220928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-0dcc7c53-8f4d-4ed0-be23-c3ea13d21724 req-9a47df47-eaf5-40d3-bb59-ca93742e85ee tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-0dcc7c53-8f4d-4ed0-be23-c3ea13d21724 req-9a47df47-eaf5-40d3-bb59-ca93742e85ee tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-0dcc7c53-8f4d-4ed0-be23-c3ea13d21724 req-9a47df47-eaf5-40d3-bb59-ca93742e85ee tempest-ServerActionsTestOtherA-1077220928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-0b960870-528f-4766-89f5-b2b292cb9980', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f0c61c0-5f94-4ce3-a69a-363690655f95', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:03:07 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-0dcc7c53-8f4d-4ed0-be23-c3ea13d21724 req-9a47df47-eaf5-40d3-bb59-ca93742e85ee tempest-ServerActionsTestOtherA-1077220928 None] attachment_update completed successfully.
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Flow 'volume_create_manager' (0cbe5bc4-11f6-499b-b092-2521a6800313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe1be6a-753e-4cf6-86b3-725186ebfc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe1be6a-753e-4cf6-86b3-725186ebfc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1565324103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d06077-77b6-4388-bd9c-d24b8be0323d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c79ad8ace4e4cb98087ef125582ce43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:03:19Z,use_quota=True,user_id='46580e6fe2484419928155dd9e69e4ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74968098-2474-41ab-b986-d098c73ed5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74968098-2474-41ab-b986-d098c73ed5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dec30f5-96c1-4886-b59a-51344d7c82e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dec30f5-96c1-4886-b59a-51344d7c82e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4d06077-77b6-4388-bd9c-d24b8be0323d', 'volume_name': 'volume-d4d06077-77b6-4388-bd9c-d24b8be0323d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daadd91c-5abf-48aa-a098-1e22ec8683b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daadd91c-5abf-48aa-a098-1e22ec8683b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6024afed-e879-45ec-a3ec-5d67d4c6c5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:19 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Volume d4d06077-77b6-4388-bd9c-d24b8be0323d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4d06077-77b6-4388-bd9c-d24b8be0323d', 'volume_size': 1}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1565324103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d06077-77b6-4388-bd9c-d24b8be0323d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c79ad8ace4e4cb98087ef125582ce43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:03:19Z,use_quota=True,user_id='46580e6fe2484419928155dd9e69e4ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Creating volume d4d06077-77b6-4388-bd9c-d24b8be0323d {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:03:19 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d4d06077-77b6-4388-bd9c-d24b8be0323d 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:19 devstack sudo[94271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d4d06077-77b6-4388-bd9c-d24b8be0323d 1073741824
Sep 25 15:03:19 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:19 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d4d06077-77b6-4388-bd9c-d24b8be0323d 1073741824" returned: 0 in 0.702s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d4d06077-77b6-4388-bd9c-d24b8be0323d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:20 devstack sudo[94277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d4d06077-77b6-4388-bd9c-d24b8be0323d
Sep 25 15:03:20 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:20 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d4d06077-77b6-4388-bd9c-d24b8be0323d" returned: 0 in 0.478s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:03:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6024afed-e879-45ec-a3ec-5d67d4c6c5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4d06077-77b6-4388-bd9c-d24b8be0323d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224eabae-36de-4c57-95ac-22a31ff402dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:20 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Volume volume-d4d06077-77b6-4388-bd9c-d24b8be0323d (d4d06077-77b6-4388-bd9c-d24b8be0323d): created successfully
Sep 25 15:03:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224eabae-36de-4c57-95ac-22a31ff402dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Flow 'volume_create_manager' (0cbe5bc4-11f6-499b-b092-2521a6800313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:03:20 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f71739b3-00fa-4241-8d78-57017f70acc2 tempest-AbsoluteLimitsTests-1006684067 None] Created volume successfully.
Sep 25 15:03:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:03:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:03:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:03:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:20 devstack sudo[94281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:03:20 devstack sudo[94281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:21 devstack sudo[94281]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.340s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:03:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:03:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:03:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:03:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Acquiring lock "cinder-d4d06077-77b6-4388-bd9c-d24b8be0323d-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:03:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Lock "cinder-d4d06077-77b6-4388-bd9c-d24b8be0323d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:03:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Acquiring lock "cinder-quobyte-d4d06077-77b6-4388-bd9c-d24b8be0323d" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:03:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Lock "cinder-quobyte-d4d06077-77b6-4388-bd9c-d24b8be0323d" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:03:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ffdf21-c82f-4c16-9f09-647256a3b985]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:03:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d4d06077-77b6-4388-bd9c-d24b8be0323d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:21 devstack sudo[94284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d4d06077-77b6-4388-bd9c-d24b8be0323d
Sep 25 15:03:21 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:22 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d4d06077-77b6-4388-bd9c-d24b8be0323d" returned: 0 in 0.575s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d4d06077-77b6-4388-bd9c-d24b8be0323d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:22 devstack sudo[94290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d4d06077-77b6-4388-bd9c-d24b8be0323d
Sep 25 15:03:22 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:22 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d4d06077-77b6-4388-bd9c-d24b8be0323d" returned: 0 in 0.464s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Lock "cinder-quobyte-d4d06077-77b6-4388-bd9c-d24b8be0323d" released by "delete_volume" :: held 1.106s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:03:22 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Created reservations ['fce1317d-d7f4-4d7f-be37-01892c00a16a', '8efebb3a-32ba-42f7-b313-386773ead188', '40d533aa-4425-47c9-8436-6536c9148eab', '25ba1c1e-b35c-4ac7-8dbb-01fd3076d00f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:03:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:03:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:03:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:22 devstack sudo[94293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:03:22 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:23 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.359s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:23 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:03:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Deleted volume successfully.
Sep 25 15:03:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-309f372f-2e5c-40c5-a7db-fa8e898a7353 tempest-AbsoluteLimitsTests-1006684067 None] Lock "cinder-d4d06077-77b6-4388-bd9c-d24b8be0323d-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Flow 'volume_create_manager' (3f4a64f8-324a-45c2-a7a7-1cc30e9fb824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04aef39c-fec7-4153-98ff-2830f2937dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04aef39c-fec7-4153-98ff-2830f2937dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1869262845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bdef018-3227-4831-a474-f10627301a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9283cba2b2f142ba89d8ea6b62ed2164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:03:28Z,use_quota=True,user_id='3b0ca287775d4be7996517992b0ba0cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b77aa5e-f35c-456a-8b54-95d15a167c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b77aa5e-f35c-456a-8b54-95d15a167c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ad3ec7-ec18-4623-8936-539d9ad49a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ad3ec7-ec18-4623-8936-539d9ad49a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bdef018-3227-4831-a474-f10627301a56', 'volume_name': 'volume-4bdef018-3227-4831-a474-f10627301a56', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5850ae54-6399-4caa-8d13-764af5a18b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5850ae54-6399-4caa-8d13-764af5a18b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6687a6c7-4f8d-4357-b25b-8adee12ffbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:28 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Volume 4bdef018-3227-4831-a474-f10627301a56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bdef018-3227-4831-a474-f10627301a56', 'volume_size': 1}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1869262845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bdef018-3227-4831-a474-f10627301a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9283cba2b2f142ba89d8ea6b62ed2164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:03:28Z,use_quota=True,user_id='3b0ca287775d4be7996517992b0ba0cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Creating volume 4bdef018-3227-4831-a474-f10627301a56 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:03:28 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:03:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4bdef018-3227-4831-a474-f10627301a56 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:28 devstack sudo[94328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4bdef018-3227-4831-a474-f10627301a56 1073741824
Sep 25 15:03:28 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:29 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4bdef018-3227-4831-a474-f10627301a56 1073741824" returned: 0 in 0.555s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4bdef018-3227-4831-a474-f10627301a56 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:29 devstack sudo[94334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4bdef018-3227-4831-a474-f10627301a56
Sep 25 15:03:29 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:29 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4bdef018-3227-4831-a474-f10627301a56" returned: 0 in 0.359s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:03:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6687a6c7-4f8d-4357-b25b-8adee12ffbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bdef018-3227-4831-a474-f10627301a56', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b12d5bf-8e59-42db-bf19-f82fa817816c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:29 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Volume volume-4bdef018-3227-4831-a474-f10627301a56 (4bdef018-3227-4831-a474-f10627301a56): created successfully
Sep 25 15:03:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b12d5bf-8e59-42db-bf19-f82fa817816c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Flow 'volume_create_manager' (3f4a64f8-324a-45c2-a7a7-1cc30e9fb824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:03:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-50ad0cb0-099f-43d9-818a-17a9386e5916 tempest-AttachVolumeNegativeTest-862497125 None] Created volume successfully.
Sep 25 15:03:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-577fcb0b-2bc2-40f8-b791-0d4d73b899ca req-9e1bed81-546d-4a55-85b0-a54f4df21406 tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-577fcb0b-2bc2-40f8-b791-0d4d73b899ca req-9e1bed81-546d-4a55-85b0-a54f4df21406 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-577fcb0b-2bc2-40f8-b791-0d4d73b899ca req-9e1bed81-546d-4a55-85b0-a54f4df21406 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-577fcb0b-2bc2-40f8-b791-0d4d73b899ca req-9e1bed81-546d-4a55-85b0-a54f4df21406 tempest-AttachVolumeNegativeTest-862497125 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-4bdef018-3227-4831-a474-f10627301a56', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a237eb75-88d8-4ec4-888f-4027b9802ad9', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:03:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-577fcb0b-2bc2-40f8-b791-0d4d73b899ca req-9e1bed81-546d-4a55-85b0-a54f4df21406 tempest-AttachVolumeNegativeTest-862497125 None] attachment_update completed successfully.
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Flow 'volume_create_manager' (f8256adf-9092-4a1a-a959-210f1a9cc4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05975861-c356-4fcb-a682-d1f2964b7647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05975861-c356-4fcb-a682-d1f2964b7647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-595626090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f8caeb-fc98-43e5-aaaa-d83bfc763bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00512082b2f24573bd212f84f767b165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:03:33Z,use_quota=True,user_id='f47c0b30104b40d6993ce20aead27c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc5a0c99-4604-451a-b565-a2c812b0113f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc5a0c99-4604-451a-b565-a2c812b0113f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc71dd2-5bdf-4940-a74a-41db8c3adfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc71dd2-5bdf-4940-a74a-41db8c3adfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52f8caeb-fc98-43e5-aaaa-d83bfc763bea', 'volume_name': 'volume-52f8caeb-fc98-43e5-aaaa-d83bfc763bea', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ae11ef-0c8e-4ffa-9128-470675959c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ae11ef-0c8e-4ffa-9128-470675959c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e90ea11-9aa9-4c34-8cf0-db5facc122d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:32 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Volume 52f8caeb-fc98-43e5-aaaa-d83bfc763bea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52f8caeb-fc98-43e5-aaaa-d83bfc763bea', 'volume_size': 1}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-595626090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52f8caeb-fc98-43e5-aaaa-d83bfc763bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00512082b2f24573bd212f84f767b165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:03:33Z,use_quota=True,user_id='f47c0b30104b40d6993ce20aead27c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Creating volume 52f8caeb-fc98-43e5-aaaa-d83bfc763bea {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:03:32 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:03:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-52f8caeb-fc98-43e5-aaaa-d83bfc763bea 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:32 devstack sudo[94360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-52f8caeb-fc98-43e5-aaaa-d83bfc763bea 1073741824
Sep 25 15:03:32 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:33 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-52f8caeb-fc98-43e5-aaaa-d83bfc763bea 1073741824" returned: 0 in 0.605s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-52f8caeb-fc98-43e5-aaaa-d83bfc763bea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:33 devstack sudo[94366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-52f8caeb-fc98-43e5-aaaa-d83bfc763bea
Sep 25 15:03:33 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:33 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-52f8caeb-fc98-43e5-aaaa-d83bfc763bea" returned: 0 in 0.448s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:03:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e90ea11-9aa9-4c34-8cf0-db5facc122d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52f8caeb-fc98-43e5-aaaa-d83bfc763bea', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9075305-eff0-47c3-bff0-8f247a1f11a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:34 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Volume volume-52f8caeb-fc98-43e5-aaaa-d83bfc763bea (52f8caeb-fc98-43e5-aaaa-d83bfc763bea): created successfully
Sep 25 15:03:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9075305-eff0-47c3-bff0-8f247a1f11a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Flow 'volume_create_manager' (f8256adf-9092-4a1a-a959-210f1a9cc4d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:03:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-71e1e7cc-e70e-4628-b1ff-8bf9f4d287bd tempest-VolumesTransfersV357Test-1620472589 None] Created volume successfully.
Sep 25 15:03:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-9470768b-7687-4239-a6c1-739e8ac2afaa req-b026b012-e3dc-4877-9534-e7669efe2b4c tempest-AttachVolumeNegativeTest-862497125 None] Terminate volume connection completed successfully.
Sep 25 15:03:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-9470768b-7687-4239-a6c1-739e8ac2afaa req-b026b012-e3dc-4877-9534-e7669efe2b4c tempest-AttachVolumeNegativeTest-862497125 None] Deleting attachment a237eb75-88d8-4ec4-888f-4027b9802ad9. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:03:35 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a5ab0a7e-6c48-4555-a87c-b0470a86f521 tempest-VolumesTransfersV357Test-1172397045 None] Transfer volume completed successfully.
Sep 25 15:03:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Acquiring lock "cinder-52f8caeb-fc98-43e5-aaaa-d83bfc763bea-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:03:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Lock "cinder-52f8caeb-fc98-43e5-aaaa-d83bfc763bea-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:03:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Acquiring lock "cinder-quobyte-52f8caeb-fc98-43e5-aaaa-d83bfc763bea" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:03:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Lock "cinder-quobyte-52f8caeb-fc98-43e5-aaaa-d83bfc763bea" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:03:36 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd6a8ee-1a0f-4348-bb44-a627eb3612e4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:03:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-52f8caeb-fc98-43e5-aaaa-d83bfc763bea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:37 devstack sudo[94408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-52f8caeb-fc98-43e5-aaaa-d83bfc763bea
Sep 25 15:03:37 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:37 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-52f8caeb-fc98-43e5-aaaa-d83bfc763bea" returned: 0 in 0.441s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-52f8caeb-fc98-43e5-aaaa-d83bfc763bea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:37 devstack sudo[94413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-52f8caeb-fc98-43e5-aaaa-d83bfc763bea
Sep 25 15:03:37 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:37 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-52f8caeb-fc98-43e5-aaaa-d83bfc763bea" returned: 0 in 0.336s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Lock "cinder-quobyte-52f8caeb-fc98-43e5-aaaa-d83bfc763bea" released by "delete_volume" :: held 0.826s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:03:37 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Created reservations ['1d2f09a9-b100-4c6d-8bb1-7031a5730d53', '8d7833c0-ec2c-4a5e-a421-aef25a86d328', 'dc5788d3-db4e-459a-ba9e-91213707fb90', '2e1a270a-a720-4c34-af89-c2154bb41cda'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:03:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:03:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:03:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:37 devstack sudo[94419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:03:37 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:38 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.357s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:03:38 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Deleted volume successfully.
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-28d42d0b-a08b-4e41-84b9-0ee1fff194c4 tempest-VolumesTransfersV357Test-1757310435 None] Lock "cinder-52f8caeb-fc98-43e5-aaaa-d83bfc763bea-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Flow 'volume_create_manager' (e0d3f8d7-e78a-40b9-b802-398458ec35d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cedc9bd-fb9a-4be4-be26-36d91a44bca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cedc9bd-fb9a-4be4-be26-36d91a44bca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-69696490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824bc17d-9979-471f-935d-85330c2b5956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00512082b2f24573bd212f84f767b165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:03:39Z,use_quota=True,user_id='f47c0b30104b40d6993ce20aead27c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad57ad0f-6a4c-449a-a784-12de8eec6793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad57ad0f-6a4c-449a-a784-12de8eec6793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20334fe-07b7-404e-b382-ee61cc822ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20334fe-07b7-404e-b382-ee61cc822ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '824bc17d-9979-471f-935d-85330c2b5956', 'volume_name': 'volume-824bc17d-9979-471f-935d-85330c2b5956', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cccae43-41e3-4987-8731-446e7e4f6d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cccae43-41e3-4987-8731-446e7e4f6d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0660fb-fbf8-4609-9d39-25600058916e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:38 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Volume 824bc17d-9979-471f-935d-85330c2b5956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-824bc17d-9979-471f-935d-85330c2b5956', 'volume_size': 1}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-69696490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824bc17d-9979-471f-935d-85330c2b5956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00512082b2f24573bd212f84f767b165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:03:39Z,use_quota=True,user_id='f47c0b30104b40d6993ce20aead27c94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Creating volume 824bc17d-9979-471f-935d-85330c2b5956 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:03:38 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:03:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-824bc17d-9979-471f-935d-85330c2b5956 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:38 devstack sudo[94423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-824bc17d-9979-471f-935d-85330c2b5956 1073741824
Sep 25 15:03:38 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:39 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-824bc17d-9979-471f-935d-85330c2b5956 1073741824" returned: 0 in 0.494s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-824bc17d-9979-471f-935d-85330c2b5956 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:39 devstack sudo[94429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-824bc17d-9979-471f-935d-85330c2b5956
Sep 25 15:03:39 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:39 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-824bc17d-9979-471f-935d-85330c2b5956" returned: 0 in 0.315s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:03:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0660fb-fbf8-4609-9d39-25600058916e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-824bc17d-9979-471f-935d-85330c2b5956', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e2cd3a-f9e9-4cb3-b28c-1b880e64e58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:39 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Volume volume-824bc17d-9979-471f-935d-85330c2b5956 (824bc17d-9979-471f-935d-85330c2b5956): created successfully
Sep 25 15:03:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e2cd3a-f9e9-4cb3-b28c-1b880e64e58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Flow 'volume_create_manager' (e0d3f8d7-e78a-40b9-b802-398458ec35d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:03:39 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3623b4a9-4329-4238-a9e4-70db26a21830 tempest-VolumesTransfersV357Test-1620472589 None] Created volume successfully.
Sep 25 15:03:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "cinder-4bdef018-3227-4831-a474-f10627301a56-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:03:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Lock "cinder-4bdef018-3227-4831-a474-f10627301a56-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:03:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "cinder-quobyte-4bdef018-3227-4831-a474-f10627301a56" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:03:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Lock "cinder-quobyte-4bdef018-3227-4831-a474-f10627301a56" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:03:40 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4350bba9-c498-41e0-9985-9335e3f3d09f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:03:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4bdef018-3227-4831-a474-f10627301a56 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:41 devstack sudo[94432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4bdef018-3227-4831-a474-f10627301a56
Sep 25 15:03:41 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Acquiring lock "cinder-824bc17d-9979-471f-935d-85330c2b5956-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:03:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Lock "cinder-824bc17d-9979-471f-935d-85330c2b5956-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:03:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Acquiring lock "cinder-quobyte-824bc17d-9979-471f-935d-85330c2b5956" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:03:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Lock "cinder-quobyte-824bc17d-9979-471f-935d-85330c2b5956" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:03:41 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[088961e9-e2aa-4f2a-a1a2-bdbfccf4d14d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:03:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-824bc17d-9979-471f-935d-85330c2b5956 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:41 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4bdef018-3227-4831-a474-f10627301a56" returned: 0 in 0.557s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4bdef018-3227-4831-a474-f10627301a56 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:41 devstack sudo[94438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4bdef018-3227-4831-a474-f10627301a56
Sep 25 15:03:41 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:41 devstack sudo[94436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-824bc17d-9979-471f-935d-85330c2b5956
Sep 25 15:03:41 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:41 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4bdef018-3227-4831-a474-f10627301a56" returned: 0 in 0.364s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Lock "cinder-quobyte-4bdef018-3227-4831-a474-f10627301a56" released by "delete_volume" :: held 0.995s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:03:41 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-824bc17d-9979-471f-935d-85330c2b5956" returned: 0 in 0.542s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-824bc17d-9979-471f-935d-85330c2b5956 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Created reservations ['df3a3edd-3cef-435a-9743-f72cbf49794e', '394bd977-c1e9-451a-adad-ffce1b54bd44', '794566ce-f358-4946-991f-f55d13df87a7', 'f4cfb8e4-1614-4395-9c1b-03dc19249b29'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:03:42 devstack sudo[94445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-824bc17d-9979-471f-935d-85330c2b5956
Sep 25 15:03:42 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:42 devstack sudo[94447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:03:42 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:42 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-824bc17d-9979-471f-935d-85330c2b5956" returned: 0 in 0.332s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Lock "cinder-quobyte-824bc17d-9979-471f-935d-85330c2b5956" released by "delete_volume" :: held 0.941s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Created reservations ['6652b5b8-724e-4272-8961-3f816c815827', 'dbcce24f-0efc-47ec-b21d-4fa9e64451f2', 'b3f89719-c43b-4b7f-aa80-65ea3d5e7140', '1055fdec-5325-4c13-815d-8b51356e52d3'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:03:42 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.337s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:03:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Deleted volume successfully.
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c38392d-883b-42b6-a93b-c763c28a6704 tempest-AttachVolumeNegativeTest-862497125 None] Lock "cinder-4bdef018-3227-4831-a474-f10627301a56-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:42 devstack sudo[94451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:03:42 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:42 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.370s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:03:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Deleted volume successfully.
Sep 25 15:03:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30b3514a-d505-4cff-82a6-50898d89aee5 tempest-VolumesTransfersV357Test-1757310435 None] Lock "cinder-824bc17d-9979-471f-935d-85330c2b5956-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:03:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "cinder-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:03:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Lock "cinder-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:03:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "cinder-quobyte-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:03:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Lock "cinder-quobyte-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:03:43 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc24ce74-b4a0-4261-a032-793d48feafc9]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:03:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:43 devstack sudo[94454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0
Sep 25 15:03:43 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:43 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0" returned: 0 in 0.519s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:43 devstack sudo[94470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0
Sep 25 15:03:43 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:44 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0" returned: 0 in 0.323s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Lock "cinder-quobyte-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0" released by "delete_volume" :: held 0.907s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:03:44 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Created reservations ['9f7a4fe0-4059-4562-8e32-6887fe0bbd7b', '5db980d0-0d68-4dda-a7bb-45afc2678e97', 'ba8fbdf9-8717-4692-a949-7ac9dda1850c', '5415b9f7-04cd-4ebb-bb0d-e4aa8901fc13'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:03:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:03:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:03:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:44 devstack sudo[94473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:03:44 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "cinder-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:03:44 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.383s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:44 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:03:44 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Deleted volume successfully.
Sep 25 15:03:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Lock "cinder-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:03:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d544a203-23e8-40be-9a28-b9534edb2534 tempest-AttachVolumeNegativeTest-862497125 None] Lock "cinder-c2d0b761-e039-4e7f-a134-4fa4a90b3ec0-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:03:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "cinder-quobyte-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:03:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Lock "cinder-quobyte-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:03:45 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d8c2ef-f035-4ec4-930f-0da1501f88cf]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:03:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:45 devstack sudo[94476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0
Sep 25 15:03:45 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:45 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0" returned: 0 in 0.467s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:45 devstack sudo[94481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0
Sep 25 15:03:45 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:45 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0" returned: 0 in 0.321s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Lock "cinder-quobyte-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0" released by "delete_volume" :: held 0.842s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:03:45 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Created reservations ['2988f240-a831-4052-99ed-ec55d1c0f25b', '70da82e7-a1c5-4478-989a-90bed2af32d6', 'e230bb18-81e9-40d0-b75e-1d630f694f67', '6a1a6fcf-5ad9-4ca5-80f7-68fc6726d3ab'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:03:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:03:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:03:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:46 devstack sudo[94484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:03:46 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:46 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.370s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:46 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:03:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Deleted volume successfully.
Sep 25 15:03:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fe1ff587-c245-4fad-8407-27bdfbc8679f tempest-AttachVolumeNegativeTest-862497125 None] Lock "cinder-3adafd0c-ec69-43d7-9f96-5e4d9c60b4b0-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Flow 'volume_create_manager' (89449fe8-12c1-46ec-857c-ab856056b5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c08e39-26a6-469f-aa01-c8017b25a096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c08e39-26a6-469f-aa01-c8017b25a096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1842317515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf72bcf8-8218-4817-9449-185295da2de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896879507555422cb7e04c079d707c92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:03:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:03:51Z,use_quota=True,user_id='f1c7a90043044140a03aabb3ecd2c027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6534dfd2-a736-478a-b821-b10af7a6f9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6534dfd2-a736-478a-b821-b10af7a6f9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fbf013-4a9f-44c8-81dc-2ca18bf67909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fbf013-4a9f-44c8-81dc-2ca18bf67909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf72bcf8-8218-4817-9449-185295da2de4', 'volume_name': 'volume-bf72bcf8-8218-4817-9449-185295da2de4', 'volume_size': 2}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1171f0c-b44e-4976-b2d9-20ed8de6440a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1171f0c-b44e-4976-b2d9-20ed8de6440a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ca4b76-f576-43fb-b594-76dc7ee7cafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:51 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Volume bf72bcf8-8218-4817-9449-185295da2de4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf72bcf8-8218-4817-9449-185295da2de4', 'volume_size': 2}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1842317515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf72bcf8-8218-4817-9449-185295da2de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896879507555422cb7e04c079d707c92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:03:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:03:51Z,use_quota=True,user_id='f1c7a90043044140a03aabb3ecd2c027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Creating volume bf72bcf8-8218-4817-9449-185295da2de4 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:03:51 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:03:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf72bcf8-8218-4817-9449-185295da2de4 2147483648 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:51 devstack sudo[94517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf72bcf8-8218-4817-9449-185295da2de4 2147483648
Sep 25 15:03:51 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:52 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf72bcf8-8218-4817-9449-185295da2de4 2147483648" returned: 0 in 0.759s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf72bcf8-8218-4817-9449-185295da2de4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:52 devstack sudo[94524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf72bcf8-8218-4817-9449-185295da2de4
Sep 25 15:03:52 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:52 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf72bcf8-8218-4817-9449-185295da2de4" returned: 0 in 0.351s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:03:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ca4b76-f576-43fb-b594-76dc7ee7cafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf72bcf8-8218-4817-9449-185295da2de4', 'volume_size': 2}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796f53c6-5185-43c7-a80c-6061a76fba35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:03:52 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Volume volume-bf72bcf8-8218-4817-9449-185295da2de4 (bf72bcf8-8218-4817-9449-185295da2de4): created successfully
Sep 25 15:03:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796f53c6-5185-43c7-a80c-6061a76fba35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:03:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Flow 'volume_create_manager' (89449fe8-12c1-46ec-857c-ab856056b5d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:03:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ed238799-ff3c-4526-92d8-742f2d6cb5ca tempest-VolumesCloneNegativeTest-2117914187 None] Created volume successfully.
Sep 25 15:03:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Acquiring lock "cinder-bf72bcf8-8218-4817-9449-185295da2de4-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:03:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Lock "cinder-bf72bcf8-8218-4817-9449-185295da2de4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:03:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Acquiring lock "cinder-quobyte-bf72bcf8-8218-4817-9449-185295da2de4" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:03:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Lock "cinder-quobyte-bf72bcf8-8218-4817-9449-185295da2de4" acquired by "delete_volume" :: waited 0.039s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:03:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b06f367-52c6-405b-9440-582470fc2121]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:03:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf72bcf8-8218-4817-9449-185295da2de4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:54 devstack sudo[94574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf72bcf8-8218-4817-9449-185295da2de4
Sep 25 15:03:54 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:54 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf72bcf8-8218-4817-9449-185295da2de4" returned: 0 in 0.542s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf72bcf8-8218-4817-9449-185295da2de4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:54 devstack sudo[94579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf72bcf8-8218-4817-9449-185295da2de4
Sep 25 15:03:54 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:54 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf72bcf8-8218-4817-9449-185295da2de4" returned: 0 in 0.355s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Lock "cinder-quobyte-bf72bcf8-8218-4817-9449-185295da2de4" released by "delete_volume" :: held 0.963s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:03:54 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Created reservations ['47cfc690-1c30-487c-bdfe-9c1dbdd502d2', 'a52eca71-fd42-43ce-bbb8-7b7b23d07b8d', '59a021e1-366e-4ef4-9fe9-8728d73e2f72', '3a14caf9-0817-4409-a725-f7176f32828f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:03:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:03:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:03:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:03:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:03:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:03:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:03:55 devstack sudo[94582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:03:55 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:03:55 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root
Sep 25 15:03:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.295s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:03:55 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:03:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Deleted volume successfully.
Sep 25 15:03:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63ec531e-c1de-496d-9497-a054d8a3c99a tempest-VolumesCloneNegativeTest-2117914187 None] Lock "cinder-bf72bcf8-8218-4817-9449-185295da2de4-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:01 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=73,cinder:INSERT=18,cinder:UPDATE=88,cinder:DELETE=9 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:04:01 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=70,cinder:INSERT=23,cinder:UPDATE=88,cinder:DELETE=4 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:04:01 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-3902c291-0157-4dad-9095-46abe12bef5c req-a17d1008-2afc-4925-a915-3a7213953baf tempest-ServerActionsTestOtherA-1077220928 None] Terminate volume connection completed successfully.
Sep 25 15:04:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-3902c291-0157-4dad-9095-46abe12bef5c req-a17d1008-2afc-4925-a915-3a7213953baf tempest-ServerActionsTestOtherA-1077220928 None] Deleting attachment 6f0c61c0-5f94-4ce3-a69a-363690655f95. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:04:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Acquiring lock "cinder-0b960870-528f-4766-89f5-b2b292cb9980-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Lock "cinder-0b960870-528f-4766-89f5-b2b292cb9980-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Acquiring lock "cinder-quobyte-0b960870-528f-4766-89f5-b2b292cb9980" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Lock "cinder-quobyte-0b960870-528f-4766-89f5-b2b292cb9980" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:01 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[de690148-4702-4f82-b8e2-f3fa5084a4ca]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:01 devstack sudo[94619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980
Sep 25 15:04:01 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:02 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980" returned: 0 in 0.699s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:02 devstack sudo[94624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980
Sep 25 15:04:02 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:02 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0b960870-528f-4766-89f5-b2b292cb9980" returned: 0 in 0.420s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Lock "cinder-quobyte-0b960870-528f-4766-89f5-b2b292cb9980" released by "delete_volume" :: held 1.204s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:02 devstack cinder-volume[87071]: DEBUG cinder.quota [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Created reservations ['808dffca-e337-406e-b39e-d72511feddb0', '5abcd0ae-324f-4a1e-8079-491a10a8cd6c', '1b5af232-727e-4127-b7f0-22361e916315', 'a18a2104-a5d9-4629-91f6-1ce0f062d919'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:04:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:02 devstack sudo[94630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:04:02 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:03 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.447s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.manager [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:04:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Deleted volume successfully.
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-3902c291-0157-4dad-9095-46abe12bef5c req-941c47cd-4b26-463f-9071-70664a0cb180 tempest-ServerActionsTestOtherA-1077220928 None] Lock "cinder-0b960870-528f-4766-89f5-b2b292cb9980-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Acquiring lock "cinder-0c4d6027-639e-4e39-bd73-631d08192848-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Lock "cinder-0c4d6027-639e-4e39-bd73-631d08192848-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Acquiring lock "cinder-quobyte-0c4d6027-639e-4e39-bd73-631d08192848" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Flow 'volume_create_manager' (13353005-3db7-4d9e-89a1-cd5e18565e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0faf3c91-d6e2-4736-a2cd-4144018afc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Lock "cinder-quobyte-0c4d6027-639e-4e39-bd73-631d08192848" acquired by "delete_volume" :: waited 0.083s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0faf3c91-d6e2-4736-a2cd-4144018afc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1700039426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0af1300-3fed-4095-aeab-7476fd00b6b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ee7973415f3a425c9585b9a039165165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:04Z,use_quota=True,user_id='abaf1cfe3b79490288d181473b913188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a51108-ffde-4e77-9b65-0447a7ab0fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a51108-ffde-4e77-9b65-0447a7ab0fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75daab95-5afc-4223-adfa-be51aad94aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75daab95-5afc-4223-adfa-be51aad94aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0af1300-3fed-4095-aeab-7476fd00b6b1', 'volume_name': 'volume-f0af1300-3fed-4095-aeab-7476fd00b6b1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22d15db-2ac8-471b-812e-ab5dde4f264b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22d15db-2ac8-471b-812e-ab5dde4f264b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53795738-dffc-44c4-83eb-f0735f4e6b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:03 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Volume f0af1300-3fed-4095-aeab-7476fd00b6b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0af1300-3fed-4095-aeab-7476fd00b6b1', 'volume_size': 1}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1700039426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0af1300-3fed-4095-aeab-7476fd00b6b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ee7973415f3a425c9585b9a039165165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:04Z,use_quota=True,user_id='abaf1cfe3b79490288d181473b913188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Creating volume f0af1300-3fed-4095-aeab-7476fd00b6b1 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:04:03 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f0af1300-3fed-4095-aeab-7476fd00b6b1 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d111fe-1fd6-49af-87c4-6552aec453dd]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c4d6027-639e-4e39-bd73-631d08192848 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:03 devstack sudo[94634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f0af1300-3fed-4095-aeab-7476fd00b6b1 1073741824
Sep 25 15:04:03 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:04 devstack sudo[94635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c4d6027-639e-4e39-bd73-631d08192848
Sep 25 15:04:04 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:04 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c4d6027-639e-4e39-bd73-631d08192848" returned: 0 in 0.498s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c4d6027-639e-4e39-bd73-631d08192848 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:04 devstack sudo[94646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c4d6027-639e-4e39-bd73-631d08192848
Sep 25 15:04:04 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:04 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f0af1300-3fed-4095-aeab-7476fd00b6b1 1073741824" returned: 0 in 0.785s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f0af1300-3fed-4095-aeab-7476fd00b6b1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:04 devstack sudo[94648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f0af1300-3fed-4095-aeab-7476fd00b6b1
Sep 25 15:04:04 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:05 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c4d6027-639e-4e39-bd73-631d08192848" returned: 0 in 0.719s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Lock "cinder-quobyte-0c4d6027-639e-4e39-bd73-631d08192848" released by "delete_volume" :: held 1.412s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:05 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f0af1300-3fed-4095-aeab-7476fd00b6b1" returned: 0 in 0.502s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53795738-dffc-44c4-83eb-f0735f4e6b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0af1300-3fed-4095-aeab-7476fd00b6b1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ab71b2-f067-46f3-ad94-33c53c364a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:05 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Volume volume-f0af1300-3fed-4095-aeab-7476fd00b6b1 (f0af1300-3fed-4095-aeab-7476fd00b6b1): created successfully
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ab71b2-f067-46f3-ad94-33c53c364a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Flow 'volume_create_manager' (13353005-3db7-4d9e-89a1-cd5e18565e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Created reservations ['a200632e-2e1c-4fa4-97f3-ffd0855309d9', 'df3c1c63-2d4b-4c9e-b2f6-6134d26c8a4e', '7d0ad407-5114-4b10-b720-63dee75c8300', '76d671e6-1a47-46cd-bcf5-20343ed76e0c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:04:05 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-214c6d18-ac40-4eaa-acc3-2b65bc600f81 tempest-VolumesGetTest-60352899 None] Created volume successfully.
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:05 devstack sudo[94653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:04:05 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:05 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.440s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:04:05 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Deleted volume successfully.
Sep 25 15:04:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-633a4632-8d5e-4517-9ca9-35edb0f25242 tempest-ServerActionsTestOtherA-1077220928 None] Lock "cinder-0c4d6027-639e-4e39-bd73-631d08192848-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Flow 'volume_create_manager' (0d949c64-5582-46e5-ac11-a018e3f299f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42935bd2-3943-4011-842c-b02b5b0f5d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42935bd2-3943-4011-842c-b02b5b0f5d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-305694885',display_name='tempest-VolumesGetTest-Volume-168100367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03530f23-aae5-460f-b3e0-b3cfdff36840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7973415f3a425c9585b9a039165165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:08Z,use_quota=True,user_id='abaf1cfe3b79490288d181473b913188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670d7847-52b2-4f27-b320-e6c8c3390876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670d7847-52b2-4f27-b320-e6c8c3390876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa0d954-cf2f-4534-b150-4d5a0dbd16ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa0d954-cf2f-4534-b150-4d5a0dbd16ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03530f23-aae5-460f-b3e0-b3cfdff36840', 'volume_name': 'volume-03530f23-aae5-460f-b3e0-b3cfdff36840', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b2daf3-b8d5-4753-9623-fffdbcb3a241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b2daf3-b8d5-4753-9623-fffdbcb3a241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6305b8a-3ab6-40e9-8c68-8716daeaacfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:08 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Volume 03530f23-aae5-460f-b3e0-b3cfdff36840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03530f23-aae5-460f-b3e0-b3cfdff36840', 'volume_size': 1}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-305694885',display_name='tempest-VolumesGetTest-Volume-168100367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03530f23-aae5-460f-b3e0-b3cfdff36840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7973415f3a425c9585b9a039165165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:08Z,use_quota=True,user_id='abaf1cfe3b79490288d181473b913188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Creating volume 03530f23-aae5-460f-b3e0-b3cfdff36840 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:04:08 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:04:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-03530f23-aae5-460f-b3e0-b3cfdff36840 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:08 devstack sudo[94699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-03530f23-aae5-460f-b3e0-b3cfdff36840 1073741824
Sep 25 15:04:08 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:09 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-03530f23-aae5-460f-b3e0-b3cfdff36840 1073741824" returned: 0 in 0.795s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-03530f23-aae5-460f-b3e0-b3cfdff36840 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:09 devstack sudo[94707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-03530f23-aae5-460f-b3e0-b3cfdff36840
Sep 25 15:04:09 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:09 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-03530f23-aae5-460f-b3e0-b3cfdff36840" returned: 0 in 0.443s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:04:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6305b8a-3ab6-40e9-8c68-8716daeaacfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03530f23-aae5-460f-b3e0-b3cfdff36840', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c93ccfb-7389-4f38-aa66-5c602daa43be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:09 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Volume volume-03530f23-aae5-460f-b3e0-b3cfdff36840 (03530f23-aae5-460f-b3e0-b3cfdff36840): created successfully
Sep 25 15:04:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c93ccfb-7389-4f38-aa66-5c602daa43be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Flow 'volume_create_manager' (0d949c64-5582-46e5-ac11-a018e3f299f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:09 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6f788c59-cba2-4a52-aaa3-4c40ef5c886f tempest-VolumesGetTest-60352899 None] Created volume successfully.
Sep 25 15:04:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Acquiring lock "cinder-03530f23-aae5-460f-b3e0-b3cfdff36840-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Lock "cinder-03530f23-aae5-460f-b3e0-b3cfdff36840-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Acquiring lock "cinder-quobyte-03530f23-aae5-460f-b3e0-b3cfdff36840" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-03530f23-aae5-460f-b3e0-b3cfdff36840" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:10 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[95618857-27b3-4eae-a35c-04131091e414]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-03530f23-aae5-460f-b3e0-b3cfdff36840 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:10 devstack sudo[94735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-03530f23-aae5-460f-b3e0-b3cfdff36840
Sep 25 15:04:10 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:11 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-03530f23-aae5-460f-b3e0-b3cfdff36840" returned: 0 in 0.694s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-03530f23-aae5-460f-b3e0-b3cfdff36840 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:11 devstack sudo[94767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-03530f23-aae5-460f-b3e0-b3cfdff36840
Sep 25 15:04:11 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-07ee5f48-54de-47a8-951e-be34c2e6ec6c tempest-GroupsTest-311267708 None] Group tempest-Group1-271022186: creating
Sep 25 15:04:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-07ee5f48-54de-47a8-951e-be34c2e6ec6c tempest-GroupsTest-311267708 None] Group tempest-Group1-271022186: created successfully
Sep 25 15:04:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-07ee5f48-54de-47a8-951e-be34c2e6ec6c tempest-GroupsTest-311267708 None] Create group completed successfully.
Sep 25 15:04:11 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-03530f23-aae5-460f-b3e0-b3cfdff36840" returned: 0 in 0.532s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-03530f23-aae5-460f-b3e0-b3cfdff36840" released by "delete_volume" :: held 1.354s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:11 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Created reservations ['c10f0cad-2494-480c-adfb-957c22f466d2', '48612cd8-8cef-406e-8aac-17cd1737b81b', 'c0495988-ab08-4efe-80ae-6b65610efdf6', 'ed86021a-15c1-4e3b-8314-04d352fcbbc7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:04:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:12 devstack sudo[94790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:04:12 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:12 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.510s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:12 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:04:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Deleted volume successfully.
Sep 25 15:04:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fa806079-d17b-416b-9d83-303865573ad0 tempest-VolumesGetTest-60352899 None] Lock "cinder-03530f23-aae5-460f-b3e0-b3cfdff36840-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ce9c67f9-e01d-474d-9414-f108a384e027 tempest-GroupsTest-311267708 None] Group tempest-Group2-2057614302: creating
Sep 25 15:04:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ce9c67f9-e01d-474d-9414-f108a384e027 tempest-GroupsTest-311267708 None] Group tempest-Group2-2057614302: created successfully
Sep 25 15:04:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ce9c67f9-e01d-474d-9414-f108a384e027 tempest-GroupsTest-311267708 None] Create group completed successfully.
Sep 25 15:04:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Acquiring lock "cinder-f0af1300-3fed-4095-aeab-7476fd00b6b1-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Lock "cinder-f0af1300-3fed-4095-aeab-7476fd00b6b1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Acquiring lock "cinder-quobyte-f0af1300-3fed-4095-aeab-7476fd00b6b1" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-f0af1300-3fed-4095-aeab-7476fd00b6b1" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:13 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53db80b-1cd1-4512-839e-a17d35ce9061]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f0af1300-3fed-4095-aeab-7476fd00b6b1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:13 devstack sudo[94811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f0af1300-3fed-4095-aeab-7476fd00b6b1
Sep 25 15:04:13 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:13 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f0af1300-3fed-4095-aeab-7476fd00b6b1" returned: 0 in 0.584s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f0af1300-3fed-4095-aeab-7476fd00b6b1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:13 devstack sudo[94818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f0af1300-3fed-4095-aeab-7476fd00b6b1
Sep 25 15:04:13 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:14 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f0af1300-3fed-4095-aeab-7476fd00b6b1" returned: 0 in 0.521s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-f0af1300-3fed-4095-aeab-7476fd00b6b1" released by "delete_volume" :: held 1.181s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:14 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Created reservations ['906bcc6d-d0a0-4ff6-82a8-922509748670', '42575876-c40c-4efa-99a8-9a0f1a8d48b9', '1eb7fc54-0e81-46d8-929c-f3b6efb74866', '62ce0d39-38e6-47e7-868e-9d3a1291c5e2'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:04:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:14 devstack sudo[94821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:04:14 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:14 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.445s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:04:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Deleted volume successfully.
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b2917143-e097-4161-a122-28ee21f23816 tempest-VolumesGetTest-60352899 None] Lock "cinder-f0af1300-3fed-4095-aeab-7476fd00b6b1-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Flow 'volume_create_manager' (f947342f-64bf-46bf-a6a6-228dbb853807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec44a2df-9e82-40f6-b191-575b03a8d64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec44a2df-9e82-40f6-b191-575b03a8d64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1336980459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=08ddc4c8-031a-4b3e-b0ab-bc828d7a492c,host='devstack@QuobyteHD#QuobyteHD',id=33f93d01-b37d-4dc3-9529-410da26cb412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5102b5bf15d345eb8d271e5a44239315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:15Z,use_quota=True,user_id='5360b40ab9f443d8beb2cc4184b50bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b5f9dcb-c356-4a47-b707-bb47cb4c116f),volume_type_id=4b5f9dcb-c356-4a47-b707-bb47cb4c116f)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a2aec2-8f8a-45df-9b54-ae947634dae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a2aec2-8f8a-45df-9b54-ae947634dae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950e3845-75c2-4671-8fab-ddc55d4fe296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950e3845-75c2-4671-8fab-ddc55d4fe296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33f93d01-b37d-4dc3-9529-410da26cb412', 'volume_name': 'volume-33f93d01-b37d-4dc3-9529-410da26cb412', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a32abe-ddbf-4445-85f7-7330892b1225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a32abe-ddbf-4445-85f7-7330892b1225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86b4030-ac5d-4a6e-b6f0-387ad17c2f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Volume 33f93d01-b37d-4dc3-9529-410da26cb412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33f93d01-b37d-4dc3-9529-410da26cb412', 'volume_size': 1}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=08ddc4c8-031a-4b3e-b0ab-bc828d7a492c,created_at=2026-09-25T13:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1336980459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=08ddc4c8-031a-4b3e-b0ab-bc828d7a492c,host='devstack@QuobyteHD#QuobyteHD',id=33f93d01-b37d-4dc3-9529-410da26cb412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5102b5bf15d345eb8d271e5a44239315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:15Z,use_quota=True,user_id='5360b40ab9f443d8beb2cc4184b50bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b5f9dcb-c356-4a47-b707-bb47cb4c116f),volume_type_id=4b5f9dcb-c356-4a47-b707-bb47cb4c116f)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Creating volume 33f93d01-b37d-4dc3-9529-410da26cb412 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:04:15 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:04:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-33f93d01-b37d-4dc3-9529-410da26cb412 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:15 devstack sudo[94825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-33f93d01-b37d-4dc3-9529-410da26cb412 1073741824
Sep 25 15:04:15 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:16 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:04:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Flow 'volume_create_manager' (9ba091c1-756e-4465-bd1c-73b650ba6d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d27f9c-2842-4165-83d2-397cca1204ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d27f9c-2842-4165-83d2-397cca1204ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-651357514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e94f126-7961-4b4c-bac1-9aef925e5a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7973415f3a425c9585b9a039165165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:16Z,use_quota=True,user_id='abaf1cfe3b79490288d181473b913188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7e896c-c108-4832-abe4-60e45a6ee2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7e896c-c108-4832-abe4-60e45a6ee2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c012141-2f76-4a73-8a35-19e9cdb7d488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c012141-2f76-4a73-8a35-19e9cdb7d488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e94f126-7961-4b4c-bac1-9aef925e5a3d', 'volume_name': 'volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb6c331-d5b2-4d81-a3f4-a9fc2f228bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb6c331-d5b2-4d81-a3f4-a9fc2f228bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7a2cb6-df68-4ebd-9fce-efb0d744bb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Volume 8e94f126-7961-4b4c-bac1-9aef925e5a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d', 'volume_size': 1}
Sep 25 15:04:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:16 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-33f93d01-b37d-4dc3-9529-410da26cb412 1073741824" returned: 0 in 0.941s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-33f93d01-b37d-4dc3-9529-410da26cb412 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:16 devstack sudo[94832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-33f93d01-b37d-4dc3-9529-410da26cb412
Sep 25 15:04:16 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:17 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-33f93d01-b37d-4dc3-9529-410da26cb412" returned: 0 in 0.434s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.568s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-651357514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e94f126-7961-4b4c-bac1-9aef925e5a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7973415f3a425c9585b9a039165165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:16Z,use_quota=True,user_id='abaf1cfe3b79490288d181473b913188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Creating volume 8e94f126-7961-4b4c-bac1-9aef925e5a3d {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:04:17 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86b4030-ac5d-4a6e-b6f0-387ad17c2f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33f93d01-b37d-4dc3-9529-410da26cb412', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019b7193-9768-40ce-a865-5805eaf7b66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:17 devstack sudo[94837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d 1073741824
Sep 25 15:04:17 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:17 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Volume volume-33f93d01-b37d-4dc3-9529-410da26cb412 (33f93d01-b37d-4dc3-9529-410da26cb412): created successfully
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019b7193-9768-40ce-a865-5805eaf7b66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Flow 'volume_create_manager' (f947342f-64bf-46bf-a6a6-228dbb853807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ed3acc7a-94a2-40fb-8b87-d9f14e572bc7 tempest-GroupsTest-311267708 None] Created volume successfully.
Sep 25 15:04:17 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d 1073741824" returned: 0 in 0.717s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:17 devstack sudo[94843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d
Sep 25 15:04:17 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:18 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d" returned: 0 in 0.323s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:04:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7a2cb6-df68-4ebd-9fce-efb0d744bb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2adb53-553f-49e2-87bd-a31dbf8221d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:18 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Volume volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d (8e94f126-7961-4b4c-bac1-9aef925e5a3d): created successfully
Sep 25 15:04:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2adb53-553f-49e2-87bd-a31dbf8221d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Flow 'volume_create_manager' (9ba091c1-756e-4465-bd1c-73b650ba6d9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c1784c7e-2247-49b4-9d2e-4da01a49f9b6 tempest-VolumesGetTest-60352899 None] Created volume successfully.
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Acquiring lock "cinder-quobyte-33f93d01-b37d-4dc3-9529-410da26cb412" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Lock "cinder-quobyte-33f93d01-b37d-4dc3-9529-410da26cb412" acquired by "delete_volume" :: waited 0.038s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6703c21e-0304-41a0-9dc7-061c9f3d3524]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-33f93d01-b37d-4dc3-9529-410da26cb412 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Flow 'volume_create_manager' (51434355-b4c2-4f5a-8ae8-2a49aa8c30cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d1c5a3-b5f1-4660-9126-8a30d883ac8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:19 devstack sudo[94846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-33f93d01-b37d-4dc3-9529-410da26cb412
Sep 25 15:04:19 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d1c5a3-b5f1-4660-9126-8a30d883ac8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1301564154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b12ca0-057a-4237-951b-fcd46ef6a0eb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ee7973415f3a425c9585b9a039165165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=8e94f126-7961-4b4c-bac1-9aef925e5a3d,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:19Z,use_quota=True,user_id='abaf1cfe3b79490288d181473b913188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b934a95-d9ba-4e76-96b0-901d208d0014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b934a95-d9ba-4e76-96b0-901d208d0014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631d417b-d436-47dc-9db1-4b530a49b076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631d417b-d436-47dc-9db1-4b530a49b076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '72b12ca0-057a-4237-951b-fcd46ef6a0eb', 'volume_name': 'volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb', 'volume_size': 1, 'source_volid': '8e94f126-7961-4b4c-bac1-9aef925e5a3d', 'source_volstatus': 'available'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f21eb78-0d82-4746-b8de-f476d7b47d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f21eb78-0d82-4746-b8de-f476d7b47d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50814a8e-e11d-407f-a6a4-8d1611bc48a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:19 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Volume 72b12ca0-057a-4237-951b-fcd46ef6a0eb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb', 'volume_size': 1, 'source_volid': '8e94f126-7961-4b4c-bac1-9aef925e5a3d', 'source_volstatus': 'available'}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:19 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Cloning volume 8e94f126-7961-4b4c-bac1-9aef925e5a3d to volume 72b12ca0-057a-4237-951b-fcd46ef6a0eb
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Creating offline snapshot 1ab5c2cf-d9f0-4fd2-8207-0639711e88a1 of volume 8e94f126-7961-4b4c-bac1-9aef925e5a3d {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ffc11b-d6dc-43f2-b809-6fc8abf34d27]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:19 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-33f93d01-b37d-4dc3-9529-410da26cb412" returned: 0 in 0.633s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-33f93d01-b37d-4dc3-9529-410da26cb412 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:20 devstack sudo[94852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-33f93d01-b37d-4dc3-9529-410da26cb412
Sep 25 15:04:20 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:20 devstack sudo[94850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d
Sep 25 15:04:20 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:20 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-33f93d01-b37d-4dc3-9529-410da26cb412" returned: 0 in 0.502s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Lock "cinder-quobyte-33f93d01-b37d-4dc3-9529-410da26cb412" released by "delete_volume" :: held 1.238s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:20 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d" returned: 0 in 0.765s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:20 devstack sudo[94859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1 1G
Sep 25 15:04:20 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:04:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Created reservations ['f851356e-80df-4543-b330-d9e2bedaf0a3'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:04:20 devstack sudo[94862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:04:20 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:21 devstack cinder-volume[87071]: WARNING cinder.quota [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1494699214 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1494699214, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:04:21 devstack cinder-volume[87071]: WARNING cinder.quota [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1494699214 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1494699214, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:04:21 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Created reservations ['28e3e3e3-1327-4602-ab28-6fe074326dd3', 'db869ecf-974e-4e2d-9596-da8d916a599d', 'ade2467a-549e-4e7e-b334-4caae48b0029', '285032ed-4cf2-4f92-af6b-ca49b61d7272'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:04:21 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.524s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:04:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:04:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:04:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:04:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:21 devstack sudo[94868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:04:21 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:21 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1 1G" returned: 0 in 1.219s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:21 devstack sudo[94871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1
Sep 25 15:04:21 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:21 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.459s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:04:22 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d2d344d1-5408-4d43-a420-e044475a1b01 tempest-GroupsTest-311267708 None] Delete group completed successfully.
Sep 25 15:04:22 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1" returned: 0 in 0.468s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:22 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1 is being set with open permissions: ugo+rw
Sep 25 15:04:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:22 devstack sudo[94877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1
Sep 25 15:04:22 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:22 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-9610aec9-d972-4908-a51b-847084358cf2 tempest-GroupsTest-311267708 None] Created reservations ['803f5774-af2f-4cab-a5b5-e08b9b5cbc85'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:04:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9610aec9-d972-4908-a51b-847084358cf2 tempest-GroupsTest-311267708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9610aec9-d972-4908-a51b-847084358cf2 tempest-GroupsTest-311267708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9610aec9-d972-4908-a51b-847084358cf2 tempest-GroupsTest-311267708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9610aec9-d972-4908-a51b-847084358cf2 tempest-GroupsTest-311267708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9610aec9-d972-4908-a51b-847084358cf2 tempest-GroupsTest-311267708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9610aec9-d972-4908-a51b-847084358cf2 tempest-GroupsTest-311267708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:22 devstack sudo[94879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:04:22 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:22 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1" returned: 0 in 0.526s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:22 devstack sudo[94882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.info
Sep 25 15:04:22 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:23 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9610aec9-d972-4908-a51b-847084358cf2 tempest-GroupsTest-311267708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.552s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:23 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-9610aec9-d972-4908-a51b-847084358cf2 tempest-GroupsTest-311267708 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:04:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9610aec9-d972-4908-a51b-847084358cf2 tempest-GroupsTest-311267708 None] Delete group completed successfully.
Sep 25 15:04:23 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.info" returned: 0 in 0.379s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:23 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.info is being set with open permissions: ugo+rw
Sep 25 15:04:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:23 devstack sudo[94886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.info
Sep 25 15:04:23 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:23 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.info" returned: 0 in 0.344s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Acquiring lock "cinder-quobyte-72b12ca0-057a-4237-951b-fcd46ef6a0eb" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-72b12ca0-057a-4237-951b-fcd46ef6a0eb" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] snapshot: 1ab5c2cf-d9f0-4fd2-8207-0639711e88a1, volume: 72b12ca0-057a-4237-951b-fcd46ef6a0eb,  {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 15:04:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:23 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[69034b55-a64e-4096-ac77-c600f964a633]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:23 devstack sudo[94889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1
Sep 25 15:04:23 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:24 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1" returned: 0 in 0.529s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:04:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[40263c14-da9e-4bed-997c-9567ba496d6d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:24 devstack sudo[94894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d
Sep 25 15:04:24 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-82098ef9-f240-4ace-9f87-bfbd81a399bf tempest-GroupsTest-311267708 None] Group tempest-GroupsTest-Group-1185515423: creating
Sep 25 15:04:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-82098ef9-f240-4ace-9f87-bfbd81a399bf tempest-GroupsTest-311267708 None] Group tempest-GroupsTest-Group-1185515423: created successfully
Sep 25 15:04:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-82098ef9-f240-4ace-9f87-bfbd81a399bf tempest-GroupsTest-311267708 None] Create group completed successfully.
Sep 25 15:04:24 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d" returned: 0 in 0.499s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 15:04:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 15:04:24 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Path /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 15:04:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:24 devstack sudo[94899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb
Sep 25 15:04:24 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:27 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:04:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Flow 'volume_create_manager' (0a704e12-b017-4d75-afb9-7c7dd8b4d3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22eaf13b-47db-4fa7-afa6-655364fadca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22eaf13b-47db-4fa7-afa6-655364fadca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1592213661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1c79c9d2-30ca-4ed4-ac87-4d2705c74841,host='devstack@QuobyteHD#QuobyteHD',id=4cb90fc9-07d5-48e5-b096-cbeb54a5acaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5102b5bf15d345eb8d271e5a44239315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:28Z,use_quota=True,user_id='5360b40ab9f443d8beb2cc4184b50bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8acc621-efcf-4f83-9c66-ce70117767a9),volume_type_id=e8acc621-efcf-4f83-9c66-ce70117767a9)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ca2fbd-0964-49c2-8b3e-7a279a6682f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ca2fbd-0964-49c2-8b3e-7a279a6682f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1d1a96-40b2-4ad7-a027-a18f61088e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1d1a96-40b2-4ad7-a027-a18f61088e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cb90fc9-07d5-48e5-b096-cbeb54a5acaf', 'volume_name': 'volume-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abdf82a7-46b8-4437-ab2c-575ca448ba1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abdf82a7-46b8-4437-ab2c-575ca448ba1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50541d27-5f22-46f7-8788-2eacb9c0dec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:28 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Volume 4cb90fc9-07d5-48e5-b096-cbeb54a5acaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf', 'volume_size': 1}
Sep 25 15:04:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:33 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb" returned: 0 in 9.018s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:33 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Image conversion details: src /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d, size 1024.00 MB, duration 9.02 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:04:33 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Converted 1024.00 MB image at 113.54 MB/s
Sep 25 15:04:33 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb is being set with open permissions: ugo+rw
Sep 25 15:04:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:33 devstack sudo[94962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb
Sep 25 15:04:33 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:34 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb" returned: 0 in 0.280s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-72b12ca0-057a-4237-951b-fcd46ef6a0eb" released by "_copy_volume_from_snapshot" :: held 10.449s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Acquiring lock "cinder-quobyte-1ab5c2cf-d9f0-4fd2-8207-0639711e88a1" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-1ab5c2cf-d9f0-4fd2-8207-0639711e88a1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Deleting offline snapshot 1ab5c2cf-d9f0-4fd2-8207-0639711e88a1 of volume 8e94f126-7961-4b4c-bac1-9aef925e5a3d {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:04:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] snapshot_file for this snap is: volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:04:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e394c85-7a72-4549-b785-4ffab617c892]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:34 devstack sudo[94965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1
Sep 25 15:04:34 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:34 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1" returned: 0 in 0.591s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:04:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebdd2f5-936d-4be4-a06d-53abbca07991]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:35 devstack sudo[94971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d
Sep 25 15:04:35 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:35 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d" returned: 0 in 0.737s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:35 devstack sudo[94976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1
Sep 25 15:04:35 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:36 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1" returned: 0 in 0.550s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:36 devstack sudo[94982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1
Sep 25 15:04:36 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:36 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d.1ab5c2cf-d9f0-4fd2-8207-0639711e88a1" returned: 0 in 0.489s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-1ab5c2cf-d9f0-4fd2-8207-0639711e88a1" released by "_delete_snapshot" :: held 2.546s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.125s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.595s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1c79c9d2-30ca-4ed4-ac87-4d2705c74841,created_at=2026-09-25T13:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1592213661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1c79c9d2-30ca-4ed4-ac87-4d2705c74841,host='devstack@QuobyteHD#QuobyteHD',id=4cb90fc9-07d5-48e5-b096-cbeb54a5acaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5102b5bf15d345eb8d271e5a44239315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:28Z,use_quota=True,user_id='5360b40ab9f443d8beb2cc4184b50bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8acc621-efcf-4f83-9c66-ce70117767a9),volume_type_id=e8acc621-efcf-4f83-9c66-ce70117767a9)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Creating volume 4cb90fc9-07d5-48e5-b096-cbeb54a5acaf {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:04:36 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:36 devstack sudo[94987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf 1073741824
Sep 25 15:04:36 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50814a8e-e11d-407f-a6a4-8d1611bc48a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb', 'volume_size': 1, 'source_volid': '8e94f126-7961-4b4c-bac1-9aef925e5a3d', 'source_volstatus': 'available'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0685c0c-f740-41d7-9f96-3f619d924cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:36 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Volume volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb (72b12ca0-057a-4237-951b-fcd46ef6a0eb): created successfully
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0685c0c-f740-41d7-9f96-3f619d924cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Flow 'volume_create_manager' (51434355-b4c2-4f5a-8ae8-2a49aa8c30cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:36 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-761e637f-1886-4648-9861-2471d8188566 tempest-VolumesGetTest-60352899 None] Created volume successfully.
Sep 25 15:04:37 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf 1073741824" returned: 0 in 1.059s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:37 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:04:38 devstack sudo[94995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf
Sep 25 15:04:38 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Flow 'volume_create_manager' (345c3d30-5b19-4ce5-a486-ebc94fa75ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2635c76d-e735-4790-bb97-061421bdbe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2635c76d-e735-4790-bb97-061421bdbe63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-260830638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab1f7b6-bb26-4ab8-8d12-db81f672b629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ec8002b3b34f94a174925dd4ad085c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:38Z,use_quota=True,user_id='ab61d19c2f784b23b56ade739f5cd9f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6bebf7-cb12-403d-8a39-67a7d66f7e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6bebf7-cb12-403d-8a39-67a7d66f7e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e2ee5e-9d3d-43a4-b212-2553214331cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e2ee5e-9d3d-43a4-b212-2553214331cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dab1f7b6-bb26-4ab8-8d12-db81f672b629', 'volume_name': 'volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8550f25-c02a-4961-ae71-b1afbe7bf92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8550f25-c02a-4961-ae71-b1afbe7bf92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e30d0f6-729a-4cca-9228-8f251df0c68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:38 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Volume dab1f7b6-bb26-4ab8-8d12-db81f672b629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629', 'volume_size': 1}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:38 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf" returned: 0 in 0.517s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.356s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-260830638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab1f7b6-bb26-4ab8-8d12-db81f672b629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ec8002b3b34f94a174925dd4ad085c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:38Z,use_quota=True,user_id='ab61d19c2f784b23b56ade739f5cd9f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Creating volume dab1f7b6-bb26-4ab8-8d12-db81f672b629 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:04:38 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50541d27-5f22-46f7-8788-2eacb9c0dec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8187156b-e286-4966-8446-215ef637d484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:38 devstack sudo[94998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629 1073741824
Sep 25 15:04:38 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:38 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Volume volume-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf (4cb90fc9-07d5-48e5-b096-cbeb54a5acaf): created successfully
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8187156b-e286-4966-8446-215ef637d484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Flow 'volume_create_manager' (0a704e12-b017-4d75-afb9-7c7dd8b4d3f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:38 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e7ac5491-909b-4d56-8f4a-34b783ac010b tempest-GroupsTest-311267708 None] Created volume successfully.
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Flow 'volume_create_manager' (076cba7a-bae1-4ddf-a8f6-736c07952b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6587167e-d595-48e4-aead-2f637f15c4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6587167e-d595-48e4-aead-2f637f15c4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1841460078',display_name='tempest-VolumesGetTest-Volume-491623541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f56a3ee8-c3fb-405c-8268-ed45bc1d2220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7973415f3a425c9585b9a039165165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:39Z,use_quota=True,user_id='abaf1cfe3b79490288d181473b913188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a730be-6034-4184-abeb-75626a2d3539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a730be-6034-4184-abeb-75626a2d3539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27f4c2f-a79c-497e-9f85-e83d37665544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27f4c2f-a79c-497e-9f85-e83d37665544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f56a3ee8-c3fb-405c-8268-ed45bc1d2220', 'volume_name': 'volume-f56a3ee8-c3fb-405c-8268-ed45bc1d2220', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8f7deb-3626-4e88-b797-e38f536a2afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8f7deb-3626-4e88-b797-e38f536a2afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e648b0-2b47-4270-aa13-16e29d2811b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:39 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Volume f56a3ee8-c3fb-405c-8268-ed45bc1d2220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f56a3ee8-c3fb-405c-8268-ed45bc1d2220', 'volume_size': 1}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:39 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629 1073741824" returned: 0 in 0.954s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:39 devstack sudo[95005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629
Sep 25 15:04:39 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:39 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629" returned: 0 in 0.371s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.624s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1841460078',display_name='tempest-VolumesGetTest-Volume-491623541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f56a3ee8-c3fb-405c-8268-ed45bc1d2220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7973415f3a425c9585b9a039165165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:39Z,use_quota=True,user_id='abaf1cfe3b79490288d181473b913188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Creating volume f56a3ee8-c3fb-405c-8268-ed45bc1d2220 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:04:39 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f56a3ee8-c3fb-405c-8268-ed45bc1d2220 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:39 devstack sudo[95008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f56a3ee8-c3fb-405c-8268-ed45bc1d2220 1073741824
Sep 25 15:04:39 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e30d0f6-729a-4cca-9228-8f251df0c68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:39 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2431d6a0-6c73-4800-b85f-a6b6039844f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:40 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Volume volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629 (dab1f7b6-bb26-4ab8-8d12-db81f672b629): created successfully
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2431d6a0-6c73-4800-b85f-a6b6039844f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Flow 'volume_create_manager' (345c3d30-5b19-4ce5-a486-ebc94fa75ca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-502cd178-fbfd-484b-aefc-91a10135069b tempest-AttachVolumeTestJSON-497406096 None] Created volume successfully.
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Flow 'volume_create_manager' (797067c9-7830-487b-9bdb-32cad26f53d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1cbbc2-a338-4709-8a6e-9d4f66aa8970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1cbbc2-a338-4709-8a6e-9d4f66aa8970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2064063337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1c79c9d2-30ca-4ed4-ac87-4d2705c74841,host='devstack@QuobyteHD#QuobyteHD',id=249d50ad-2946-441d-a89a-4a4850f0dda0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5102b5bf15d345eb8d271e5a44239315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:40Z,use_quota=True,user_id='5360b40ab9f443d8beb2cc4184b50bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8acc621-efcf-4f83-9c66-ce70117767a9),volume_type_id=e8acc621-efcf-4f83-9c66-ce70117767a9)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a868e92-b429-4237-8f3e-4bf940f48594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a868e92-b429-4237-8f3e-4bf940f48594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9829314f-35ab-4b69-b000-4392768eeb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9829314f-35ab-4b69-b000-4392768eeb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '249d50ad-2946-441d-a89a-4a4850f0dda0', 'volume_name': 'volume-249d50ad-2946-441d-a89a-4a4850f0dda0', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0acae7-3bab-4c54-a770-c67c27cad885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0acae7-3bab-4c54-a770-c67c27cad885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f59748e-d6ee-4ab7-ad6a-d4e2f816aa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:40 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Volume 249d50ad-2946-441d-a89a-4a4850f0dda0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-249d50ad-2946-441d-a89a-4a4850f0dda0', 'volume_size': 1}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:40 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f56a3ee8-c3fb-405c-8268-ed45bc1d2220 1073741824" returned: 0 in 0.697s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f56a3ee8-c3fb-405c-8268-ed45bc1d2220 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:40 devstack sudo[95014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f56a3ee8-c3fb-405c-8268-ed45bc1d2220
Sep 25 15:04:40 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:40 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f56a3ee8-c3fb-405c-8268-ed45bc1d2220" returned: 0 in 0.299s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.661s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1c79c9d2-30ca-4ed4-ac87-4d2705c74841,created_at=2026-09-25T13:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2064063337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1c79c9d2-30ca-4ed4-ac87-4d2705c74841,host='devstack@QuobyteHD#QuobyteHD',id=249d50ad-2946-441d-a89a-4a4850f0dda0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5102b5bf15d345eb8d271e5a44239315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:40Z,use_quota=True,user_id='5360b40ab9f443d8beb2cc4184b50bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8acc621-efcf-4f83-9c66-ce70117767a9),volume_type_id=e8acc621-efcf-4f83-9c66-ce70117767a9)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Creating volume 249d50ad-2946-441d-a89a-4a4850f0dda0 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:04:40 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:04:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-249d50ad-2946-441d-a89a-4a4850f0dda0 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e648b0-2b47-4270-aa13-16e29d2811b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f56a3ee8-c3fb-405c-8268-ed45bc1d2220', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636486ed-6d57-46e2-8e9b-6346e74d34ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:41 devstack sudo[95017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-249d50ad-2946-441d-a89a-4a4850f0dda0 1073741824
Sep 25 15:04:41 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:41 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Volume volume-f56a3ee8-c3fb-405c-8268-ed45bc1d2220 (f56a3ee8-c3fb-405c-8268-ed45bc1d2220): created successfully
Sep 25 15:04:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636486ed-6d57-46e2-8e9b-6346e74d34ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Flow 'volume_create_manager' (076cba7a-bae1-4ddf-a8f6-736c07952b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:41 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d7545c04-8fd4-46f6-bb6a-3aac4962fc32 tempest-VolumesGetTest-60352899 None] Created volume successfully.
Sep 25 15:04:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Acquiring lock "cinder-f56a3ee8-c3fb-405c-8268-ed45bc1d2220-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Lock "cinder-f56a3ee8-c3fb-405c-8268-ed45bc1d2220-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Acquiring lock "cinder-quobyte-f56a3ee8-c3fb-405c-8268-ed45bc1d2220" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-f56a3ee8-c3fb-405c-8268-ed45bc1d2220" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:41 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-249d50ad-2946-441d-a89a-4a4850f0dda0 1073741824" returned: 0 in 0.784s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:41 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fb706c-5d50-4cba-ac8b-6955bbb90e43]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f56a3ee8-c3fb-405c-8268-ed45bc1d2220 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-249d50ad-2946-441d-a89a-4a4850f0dda0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:41 devstack sudo[95028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-249d50ad-2946-441d-a89a-4a4850f0dda0
Sep 25 15:04:41 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:41 devstack sudo[95027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f56a3ee8-c3fb-405c-8268-ed45bc1d2220
Sep 25 15:04:41 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:42 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-249d50ad-2946-441d-a89a-4a4850f0dda0" returned: 0 in 0.355s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:04:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f59748e-d6ee-4ab7-ad6a-d4e2f816aa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-249d50ad-2946-441d-a89a-4a4850f0dda0', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5a3484-7ca2-4489-abec-8576c1433987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Volume volume-249d50ad-2946-441d-a89a-4a4850f0dda0 (249d50ad-2946-441d-a89a-4a4850f0dda0): created successfully
Sep 25 15:04:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5a3484-7ca2-4489-abec-8576c1433987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Flow 'volume_create_manager' (797067c9-7830-487b-9bdb-32cad26f53d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0f47d442-b7e1-4216-af49-e774ac806d58 tempest-GroupsTest-311267708 None] Created volume successfully.
Sep 25 15:04:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-2e70302c-ab8a-4981-87ea-db851edf8851 req-7c07f6d8-dea5-4830-b20c-07f62a332a09 tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-2e70302c-ab8a-4981-87ea-db851edf8851 req-7c07f6d8-dea5-4830-b20c-07f62a332a09 tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-2e70302c-ab8a-4981-87ea-db851edf8851 req-7c07f6d8-dea5-4830-b20c-07f62a332a09 tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:42 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f56a3ee8-c3fb-405c-8268-ed45bc1d2220" returned: 0 in 0.732s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f56a3ee8-c3fb-405c-8268-ed45bc1d2220 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-2e70302c-ab8a-4981-87ea-db851edf8851 req-7c07f6d8-dea5-4830-b20c-07f62a332a09 tempest-AttachVolumeTestJSON-497406096 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52377c54-b4d6-4a76-906f-c11eb36b1009', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:04:42 devstack sudo[95044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f56a3ee8-c3fb-405c-8268-ed45bc1d2220
Sep 25 15:04:42 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-2e70302c-ab8a-4981-87ea-db851edf8851 req-7c07f6d8-dea5-4830-b20c-07f62a332a09 tempest-AttachVolumeTestJSON-497406096 None] attachment_update completed successfully.
Sep 25 15:04:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f56a3ee8-c3fb-405c-8268-ed45bc1d2220" returned: 0 in 0.527s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:43 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:43 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-01a91f83-2621-4a43-833c-4161762d0f34 tempest-GroupsTest-311267708 None] Update group completed successfully.
Sep 25 15:04:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-f56a3ee8-c3fb-405c-8268-ed45bc1d2220" released by "delete_volume" :: held 1.345s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:43 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Created reservations ['c2aeef72-aa23-459e-ba9f-be793af3cf46', 'bd33fbc5-b729-4a73-9f98-7cd33c83b3a4', 'dab52192-8278-4d0b-8451-ed16d3abf295', '4386b355-f52a-4cec-aa4e-95ccb11c75b8'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:04:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:43 devstack sudo[95458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:04:43 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:43 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.358s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:43 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:04:43 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Deleted volume successfully.
Sep 25 15:04:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-089cafce-e604-410e-aa30-f0c17aa72469 tempest-VolumesGetTest-60352899 None] Lock "cinder-f56a3ee8-c3fb-405c-8268-ed45bc1d2220-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Acquiring lock "cinder-72b12ca0-057a-4237-951b-fcd46ef6a0eb-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Lock "cinder-72b12ca0-057a-4237-951b-fcd46ef6a0eb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Acquiring lock "cinder-quobyte-72b12ca0-057a-4237-951b-fcd46ef6a0eb" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-72b12ca0-057a-4237-951b-fcd46ef6a0eb" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:44 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e77ccfc-f746-4731-a694-54a6aa09788d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:44 devstack sudo[95465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb
Sep 25 15:04:44 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:44 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fd267ee6-af85-4869-b02d-9083e4d4f3a4 tempest-GroupsTest-311267708 None] Update group completed successfully.
Sep 25 15:04:45 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb" returned: 0 in 0.670s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:45 devstack sudo[95470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb
Sep 25 15:04:45 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:45 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72b12ca0-057a-4237-951b-fcd46ef6a0eb" returned: 0 in 0.372s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-72b12ca0-057a-4237-951b-fcd46ef6a0eb" released by "delete_volume" :: held 1.131s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Created reservations ['6934ed76-44f4-432f-95e8-97b2bb887e8a', '3806c0b4-cf49-4cdc-9e32-a10c93d5b464', '66d0fba5-89dd-4709-99ee-6a1c2dd7f291', '78b53bc3-6f32-4b5e-be0e-5509e864d679'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Flow 'volume_create_manager' (de7785c1-b3c7-43e5-ae4e-a701c7e03913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af12f8a0-c5de-4bad-a09c-abbfcc90a857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af12f8a0-c5de-4bad-a09c-abbfcc90a857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-627518220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7232c95a-8a10-4b47-9bde-ac5fffe5355b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ec8002b3b34f94a174925dd4ad085c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:46Z,use_quota=True,user_id='ab61d19c2f784b23b56ade739f5cd9f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf7fea5-652e-4b5f-9e61-e8f3eb29f6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf7fea5-652e-4b5f-9e61-e8f3eb29f6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeefb749-f17a-40ac-bd3e-ed48a1b914c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeefb749-f17a-40ac-bd3e-ed48a1b914c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7232c95a-8a10-4b47-9bde-ac5fffe5355b', 'volume_name': 'volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c76471-72a0-4a8d-88cf-c1982d880ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c76471-72a0-4a8d-88cf-c1982d880ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96af0790-2523-4295-bbd0-0da2ddd5b55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Volume 7232c95a-8a10-4b47-9bde-ac5fffe5355b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b', 'volume_size': 1}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-627518220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7232c95a-8a10-4b47-9bde-ac5fffe5355b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ec8002b3b34f94a174925dd4ad085c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:46Z,use_quota=True,user_id='ab61d19c2f784b23b56ade739f5cd9f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Creating volume 7232c95a-8a10-4b47-9bde-ac5fffe5355b {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:04:45 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:45 devstack sudo[95473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b 1073741824
Sep 25 15:04:45 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:45 devstack sudo[95475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:04:45 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:46 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.371s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:46 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:04:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Deleted volume successfully.
Sep 25 15:04:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7aee7f6a-e024-4b58-816f-7c06986c1052 tempest-VolumesGetTest-60352899 None] Lock "cinder-72b12ca0-057a-4237-951b-fcd46ef6a0eb-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:46 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b 1073741824" returned: 0 in 0.756s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:46 devstack sudo[95485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b
Sep 25 15:04:46 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Acquiring lock "cinder-8e94f126-7961-4b4c-bac1-9aef925e5a3d-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Lock "cinder-8e94f126-7961-4b4c-bac1-9aef925e5a3d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Acquiring lock "cinder-quobyte-249d50ad-2946-441d-a89a-4a4850f0dda0" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Acquiring lock "cinder-quobyte-8e94f126-7961-4b4c-bac1-9aef925e5a3d" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Lock "cinder-quobyte-249d50ad-2946-441d-a89a-4a4850f0dda0" acquired by "delete_volume" :: waited 0.045s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:47 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-8e94f126-7961-4b4c-bac1-9aef925e5a3d" acquired by "delete_volume" :: waited 0.051s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b144b7b5-3a54-4a8f-a0cc-89f62cc363d1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-249d50ad-2946-441d-a89a-4a4850f0dda0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b" returned: 0 in 0.615s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebd9bb8-8f23-4a4e-90f5-11b0eaa9767d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96af0790-2523-4295-bbd0-0da2ddd5b55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdd045c-0b85-4663-90a6-1bf6b862ed12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:47 devstack sudo[95490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-249d50ad-2946-441d-a89a-4a4850f0dda0
Sep 25 15:04:47 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Volume volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b (7232c95a-8a10-4b47-9bde-ac5fffe5355b): created successfully
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdd045c-0b85-4663-90a6-1bf6b862ed12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Flow 'volume_create_manager' (de7785c1-b3c7-43e5-ae4e-a701c7e03913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:47 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-37ec292b-8d36-4882-8589-1b5a1b983026 tempest-AttachVolumeTestJSON-497406096 None] Created volume successfully.
Sep 25 15:04:47 devstack sudo[95491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d
Sep 25 15:04:47 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:47 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-249d50ad-2946-441d-a89a-4a4850f0dda0" returned: 0 in 0.707s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-249d50ad-2946-441d-a89a-4a4850f0dda0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:47 devstack sudo[95504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-249d50ad-2946-441d-a89a-4a4850f0dda0
Sep 25 15:04:47 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:47 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d" returned: 0 in 0.728s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:47 devstack sudo[95508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d
Sep 25 15:04:47 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:48 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-249d50ad-2946-441d-a89a-4a4850f0dda0" returned: 0 in 0.465s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Lock "cinder-quobyte-249d50ad-2946-441d-a89a-4a4850f0dda0" released by "delete_volume" :: held 1.294s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Acquiring lock "cinder-quobyte-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:04:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Lock "cinder-quobyte-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:04:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69fcd02-c0e1-473d-a7bf-06309dba0fdc]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:48 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8e94f126-7961-4b4c-bac1-9aef925e5a3d" returned: 0 in 0.575s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-8e94f126-7961-4b4c-bac1-9aef925e5a3d" released by "delete_volume" :: held 1.450s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:48 devstack sudo[95515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf
Sep 25 15:04:48 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:48 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Created reservations ['ecb8e078-fb83-43a7-af9f-fb210e051b51', '38b12778-46a2-4ca6-9743-eac046eed8ff', '7267e7b3-b52a-4bad-8f2c-0b60e56276db', '7f34cd5a-132d-4ab5-aea9-02511021e41e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:04:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:49 devstack sudo[95525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:04:49 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:49 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf" returned: 0 in 0.672s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:49 devstack sudo[95529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf
Sep 25 15:04:49 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:49 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.585s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:49 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:04:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Deleted volume successfully.
Sep 25 15:04:49 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf" returned: 0 in 0.477s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-acac23a1-6a07-45d9-a1b7-fa541690dfda tempest-VolumesGetTest-60352899 None] Lock "cinder-8e94f126-7961-4b4c-bac1-9aef925e5a3d-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Lock "cinder-quobyte-4cb90fc9-07d5-48e5-b096-cbeb54a5acaf" released by "delete_volume" :: held 1.259s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:04:49 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Created reservations ['f2b9552a-5c74-44c1-86c8-a5248b2a571d'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:04:49 devstack cinder-volume[87071]: WARNING cinder.quota [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-560695101 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-560695101, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:04:49 devstack cinder-volume[87071]: WARNING cinder.quota [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-560695101 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-560695101, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:04:49 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Created reservations ['de36b19d-7b47-4631-93c9-5152133a0419', '2ef65647-4631-4f1b-a742-4f0090d4b230', '4fea5a27-8114-4161-a1ce-a7a10df8bf5a', 'c0105b99-73a6-4f70-ae81-10eac7ba08b3'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:04:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-684bd7a2-5727-48e7-b11c-19982f17e090 req-cf289940-82ed-4789-ab0e-1428b75bb649 tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-684bd7a2-5727-48e7-b11c-19982f17e090 req-cf289940-82ed-4789-ab0e-1428b75bb649 tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-684bd7a2-5727-48e7-b11c-19982f17e090 req-cf289940-82ed-4789-ab0e-1428b75bb649 tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.067s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-684bd7a2-5727-48e7-b11c-19982f17e090 req-cf289940-82ed-4789-ab0e-1428b75bb649 tempest-AttachVolumeTestJSON-497406096 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b61486de-441e-45ec-8ef4-649f7688e67e', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:04:50 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Created reservations ['734d111a-de4d-4b98-80f2-2594e42d5013', '65e852c8-6b54-4785-b2c8-965a8842bc09', 'fcf4a7c3-e474-4151-84e1-c4c063002607', '17b03e84-1aee-4831-95dc-03bf5b2893ea'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:04:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-684bd7a2-5727-48e7-b11c-19982f17e090 req-cf289940-82ed-4789-ab0e-1428b75bb649 tempest-AttachVolumeTestJSON-497406096 None] attachment_update completed successfully.
Sep 25 15:04:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:50 devstack sudo[95562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:04:50 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:51 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:04:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Flow 'volume_create_manager' (c5c23399-6484-4ed6-ac40-9f7b24be443d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:04:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46542e24-e41e-486b-b2cb-8192da8b2929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:51 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46542e24-e41e-486b-b2cb-8192da8b2929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-418038045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901b8b2d-7c3a-4d4d-9cae-93a454872451,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ee7973415f3a425c9585b9a039165165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:51Z,use_quota=True,user_id='abaf1cfe3b79490288d181473b913188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d8810b-20f5-4ddb-b4d6-822c41976344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d8810b-20f5-4ddb-b4d6-822c41976344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf7f88e-6d64-4b26-aba6-5c30843585f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:51 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 15:04:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.864s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:51 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:04:51 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f3a5f6f9-42be-48d1-9db8-86db380b159f tempest-GroupsTest-311267708 None] Delete group completed successfully.
Sep 25 15:04:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf7f88e-6d64-4b26-aba6-5c30843585f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '901b8b2d-7c3a-4d4d-9cae-93a454872451', 'volume_name': 'volume-901b8b2d-7c3a-4d4d-9cae-93a454872451', 'volume_size': 1, 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd97dcba93bf843d9acf4a870a4730210', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'created_at': datetime.datetime(2026, 9, 25, 12, 52, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 52, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a354fa4c-98b3-48a7-8483-e976ebf152bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x763825ce0ce0>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7139ffdb-2145-4e77-9b9e-d2d3e1a99faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7139ffdb-2145-4e77-9b9e-d2d3e1a99faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:04:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf16d1a-4e2d-457b-93e6-f439ac8b2805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:04:52 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Volume 901b8b2d-7c3a-4d4d-9cae-93a454872451: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-901b8b2d-7c3a-4d4d-9cae-93a454872451', 'volume_size': 1, 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd97dcba93bf843d9acf4a870a4730210', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'created_at': datetime.datetime(2026, 9, 25, 12, 52, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 52, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a354fa4c-98b3-48a7-8483-e976ebf152bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x763825ce0ce0>}
Sep 25 15:04:52 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Trying to clone 901b8b2d-7c3a-4d4d-9cae-93a454872451 from image a354fa4c-98b3-48a7-8483-e976ebf152bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 15:04:53 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_n9qcasr4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 15:04:53 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 15:04:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[670464a5-489d-41eb-8400-c827f2a4f083]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_n9qcasr4devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:53 devstack sudo[95621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_n9qcasr4devstack@QuobyteHD
Sep 25 15:04:53 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:54 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_n9qcasr4devstack@QuobyteHD" returned: 0 in 0.657s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:54 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Temporary image a354fa4c-98b3-48a7-8483-e976ebf152bc is fetched for user abaf1cfe3b79490288d181473b913188. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 15:04:54 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2511fa9c-427e-4d2d-9b0a-da9187fdc73d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_n9qcasr4devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:54 devstack sudo[95638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_n9qcasr4devstack@QuobyteHD
Sep 25 15:04:54 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:54 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_n9qcasr4devstack@QuobyteHD" returned: 0 in 0.638s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-418038045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901b8b2d-7c3a-4d4d-9cae-93a454872451,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ee7973415f3a425c9585b9a039165165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:04:51Z,use_quota=True,user_id='abaf1cfe3b79490288d181473b913188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:04:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Creating volume 901b8b2d-7c3a-4d4d-9cae-93a454872451 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:04:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:04:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:04:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:04:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:04:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:04:55 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:04:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:55 devstack sudo[95648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451 1073741824
Sep 25 15:04:55 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-b6e83f72-a606-4dfb-9838-f7bd3dc6ff33 req-ec288536-0a88-45aa-98c5-4b86a0f9bc86 tempest-AttachVolumeTestJSON-497406096 None] Terminate volume connection completed successfully.
Sep 25 15:04:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-b6e83f72-a606-4dfb-9838-f7bd3dc6ff33 req-ec288536-0a88-45aa-98c5-4b86a0f9bc86 tempest-AttachVolumeTestJSON-497406096 None] Deleting attachment 52377c54-b4d6-4a76-906f-c11eb36b1009. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:04:55 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451 1073741824" returned: 0 in 0.859s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:56 devstack sudo[95656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451
Sep 25 15:04:56 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:56 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451" returned: 0 in 0.672s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:04:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:04:56 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Attempting download of a354fa4c-98b3-48a7-8483-e976ebf152bc ((None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}])) to volume 901b8b2d-7c3a-4d4d-9cae-93a454872451. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 15:04:56 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[79911695-d53d-4ed4-ac8a-86685facdd54]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_swi5ay4x {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:57 devstack sudo[95700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_swi5ay4x
Sep 25 15:04:57 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:57 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_swi5ay4x" returned: 0 in 0.795s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_swi5ay4x {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-6deb98c7-4bf5-4575-a157-be0a1b7d5a43 req-e1659498-36f6-4731-8fa7-99c943d6bbdf tempest-AttachVolumeTestJSON-497406096 None] Terminate volume connection completed successfully.
Sep 25 15:04:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-6deb98c7-4bf5-4575-a157-be0a1b7d5a43 req-e1659498-36f6-4731-8fa7-99c943d6bbdf tempest-AttachVolumeTestJSON-497406096 None] Deleting attachment b61486de-441e-45ec-8ef4-649f7688e67e. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:04:58 devstack sudo[95750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_swi5ay4x
Sep 25 15:04:58 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:58 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_swi5ay4x" returned: 1 in 0.870s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_swi5ay4x' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:04:58 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd0eb53-eaee-4426-bfc3-d940e6a80b9c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:04:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_n9qcasr4devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:58 devstack sudo[95776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_n9qcasr4devstack@QuobyteHD
Sep 25 15:04:58 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:04:59 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root
Sep 25 15:04:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_n9qcasr4devstack@QuobyteHD" returned: 0 in 0.525s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:04:59 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] a354fa4c-98b3-48a7-8483-e976ebf152bc was qcow2, converting to qcow2 {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 15:04:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_n9qcasr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:04:59 devstack sudo[95788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_n9qcasr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451
Sep 25 15:04:59 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:03 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_n9qcasr4devstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451" returned: 0 in 4.519s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:03 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_n9qcasr4devstack@QuobyteHD, size 112.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:05:03 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Converted 112.00 MB image at 24.74 MB/s
Sep 25 15:05:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:03 devstack sudo[95876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451 1G
Sep 25 15:05:03 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:04 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451 1G" returned: 0 in 0.913s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:04 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Downloaded image a354fa4c-98b3-48a7-8483-e976ebf152bc ((None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}])) to volume 901b8b2d-7c3a-4d4d-9cae-93a454872451 successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 15:05:04 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Temporary image a354fa4c-98b3-48a7-8483-e976ebf152bc for user abaf1cfe3b79490288d181473b913188 is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 15:05:04 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Marking volume 901b8b2d-7c3a-4d4d-9cae-93a454872451 as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 15:05:04 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=110,cinder:UPDATE=135,cinder:INSERT=27,cinder:DELETE=6 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:05:04 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Copying metadata from image a354fa4c-98b3-48a7-8483-e976ebf152bc to 901b8b2d-7c3a-4d4d-9cae-93a454872451. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 15:05:04 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Creating volume glance metadata for volume 901b8b2d-7c3a-4d4d-9cae-93a454872451 backed by image a354fa4c-98b3-48a7-8483-e976ebf152bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 15:05:04 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=113,cinder:INSERT=30,cinder:UPDATE=125,cinder:DELETE=11 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:05:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf16d1a-4e2d-457b-93e6-f439ac8b2805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-901b8b2d-7c3a-4d4d-9cae-93a454872451', 'volume_size': 1, 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd97dcba93bf843d9acf4a870a4730210', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'created_at': datetime.datetime(2026, 9, 25, 12, 52, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 52, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a354fa4c-98b3-48a7-8483-e976ebf152bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x763825ce0ce0>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57947d6d-ebd2-4b00-81bd-bff0f3691b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:05 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Volume volume-901b8b2d-7c3a-4d4d-9cae-93a454872451 (901b8b2d-7c3a-4d4d-9cae-93a454872451): created successfully
Sep 25 15:05:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57947d6d-ebd2-4b00-81bd-bff0f3691b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Flow 'volume_create_manager' (c5c23399-6484-4ed6-ac40-9f7b24be443d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:05:05 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-243996b7-9062-4fb6-aff9-831aa8934491 tempest-VolumesGetTest-60352899 None] Created volume successfully.
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Flow 'volume_create_manager' (e9bff5d7-964b-42ed-80d4-07ddb8130778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e62d8bb-aa42-465a-8e50-5b5773276d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e62d8bb-aa42-465a-8e50-5b5773276d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:05:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1105981952',display_name='tempest-VolumesGetTest-Volume-1972838265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d97132b-e124-46c3-9beb-b9ac1b5387eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7973415f3a425c9585b9a039165165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:05:07Z,use_quota=True,user_id='abaf1cfe3b79490288d181473b913188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c28a58-41bc-49a4-8065-c7d142a14eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c28a58-41bc-49a4-8065-c7d142a14eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb41e822-adb2-4d72-a2d6-33df067a24c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb41e822-adb2-4d72-a2d6-33df067a24c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d97132b-e124-46c3-9beb-b9ac1b5387eb', 'volume_name': 'volume-1d97132b-e124-46c3-9beb-b9ac1b5387eb', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2363e2e1-626c-4b59-ad21-e5f30f4e7d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2363e2e1-626c-4b59-ad21-e5f30f4e7d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bdb304f-f219-40aa-af01-89b99c3b7a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:07 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Volume 1d97132b-e124-46c3-9beb-b9ac1b5387eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d97132b-e124-46c3-9beb-b9ac1b5387eb', 'volume_size': 1}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:05:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1105981952',display_name='tempest-VolumesGetTest-Volume-1972838265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d97132b-e124-46c3-9beb-b9ac1b5387eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7973415f3a425c9585b9a039165165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:05:07Z,use_quota=True,user_id='abaf1cfe3b79490288d181473b913188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Creating volume 1d97132b-e124-46c3-9beb-b9ac1b5387eb {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:05:07 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:05:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1d97132b-e124-46c3-9beb-b9ac1b5387eb 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:07 devstack sudo[95884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1d97132b-e124-46c3-9beb-b9ac1b5387eb 1073741824
Sep 25 15:05:07 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:09 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1d97132b-e124-46c3-9beb-b9ac1b5387eb 1073741824" returned: 0 in 1.252s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1d97132b-e124-46c3-9beb-b9ac1b5387eb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:09 devstack sudo[95890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1d97132b-e124-46c3-9beb-b9ac1b5387eb
Sep 25 15:05:09 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:09 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1d97132b-e124-46c3-9beb-b9ac1b5387eb" returned: 0 in 0.634s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:05:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bdb304f-f219-40aa-af01-89b99c3b7a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d97132b-e124-46c3-9beb-b9ac1b5387eb', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0b4d29-a8f6-4019-9629-e146d4a0a46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:09 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Volume volume-1d97132b-e124-46c3-9beb-b9ac1b5387eb (1d97132b-e124-46c3-9beb-b9ac1b5387eb): created successfully
Sep 25 15:05:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0b4d29-a8f6-4019-9629-e146d4a0a46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Flow 'volume_create_manager' (e9bff5d7-964b-42ed-80d4-07ddb8130778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:05:10 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-00d542d2-d0dd-437e-8ebb-633a4a6c3525 tempest-VolumesGetTest-60352899 None] Created volume successfully.
Sep 25 15:05:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Acquiring lock "cinder-1d97132b-e124-46c3-9beb-b9ac1b5387eb-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Lock "cinder-1d97132b-e124-46c3-9beb-b9ac1b5387eb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "cinder-7232c95a-8a10-4b47-9bde-ac5fffe5355b-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Lock "cinder-7232c95a-8a10-4b47-9bde-ac5fffe5355b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Acquiring lock "cinder-quobyte-1d97132b-e124-46c3-9beb-b9ac1b5387eb" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-1d97132b-e124-46c3-9beb-b9ac1b5387eb" acquired by "delete_volume" :: waited 0.041s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "cinder-quobyte-7232c95a-8a10-4b47-9bde-ac5fffe5355b" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19793cf-5dbe-499c-885c-a0ea0cb36b9e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:05:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1d97132b-e124-46c3-9beb-b9ac1b5387eb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Lock "cinder-quobyte-7232c95a-8a10-4b47-9bde-ac5fffe5355b" acquired by "delete_volume" :: waited 0.090s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caba129-6c80-44d6-bf3c-9289ba8017ee]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:05:11 devstack sudo[95909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1d97132b-e124-46c3-9beb-b9ac1b5387eb
Sep 25 15:05:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:11 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:11 devstack sudo[95910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b
Sep 25 15:05:11 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:12 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1d97132b-e124-46c3-9beb-b9ac1b5387eb" returned: 0 in 0.927s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1d97132b-e124-46c3-9beb-b9ac1b5387eb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:12 devstack sudo[95925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1d97132b-e124-46c3-9beb-b9ac1b5387eb
Sep 25 15:05:12 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:12 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b" returned: 0 in 1.071s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:12 devstack sudo[95937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b
Sep 25 15:05:12 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:13 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1d97132b-e124-46c3-9beb-b9ac1b5387eb" returned: 0 in 0.621s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-1d97132b-e124-46c3-9beb-b9ac1b5387eb" released by "delete_volume" :: held 1.672s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Created reservations ['b6ed8ec9-1d3b-4eca-8239-521ebe19f714', '7340240c-ca52-45e0-aaf7-38937762379c', '90fbc30c-dca0-4575-9c28-88ccf8737bc3', '35fc2556-449a-43bf-82f4-7faae56c4297'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:13 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7232c95a-8a10-4b47-9bde-ac5fffe5355b" returned: 0 in 0.587s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:13 devstack sudo[95947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:05:13 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Lock "cinder-quobyte-7232c95a-8a10-4b47-9bde-ac5fffe5355b" released by "delete_volume" :: held 1.819s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Created reservations ['da7032b6-4689-463d-9d00-02cd081ff2e3', '01124a4f-ea41-4d22-ab68-dd878e0bd589', '0b7150bf-c151-46c3-8b0c-3da72a1d7a1b', '7b0036bc-0b01-45a7-9511-a8f59a7ea671'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:05:13 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.427s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:05:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Deleted volume successfully.
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-417fccae-4ee6-4718-a2b7-95370594eed9 tempest-VolumesGetTest-60352899 None] Lock "cinder-1d97132b-e124-46c3-9beb-b9ac1b5387eb-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:13 devstack sudo[95958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:05:13 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "cinder-dab1f7b6-bb26-4ab8-8d12-db81f672b629-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Lock "cinder-dab1f7b6-bb26-4ab8-8d12-db81f672b629-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Acquiring lock "cinder-901b8b2d-7c3a-4d4d-9cae-93a454872451-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Lock "cinder-901b8b2d-7c3a-4d4d-9cae-93a454872451-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "cinder-quobyte-dab1f7b6-bb26-4ab8-8d12-db81f672b629" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.405s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:05:14 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Lock "cinder-quobyte-dab1f7b6-bb26-4ab8-8d12-db81f672b629" acquired by "delete_volume" :: waited 0.051s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Deleted volume successfully.
Sep 25 15:05:14 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed0ff6d-9701-490e-a1c3-41a41368357b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:05:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Acquiring lock "cinder-quobyte-901b8b2d-7c3a-4d4d-9cae-93a454872451" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f0ee2ebd-f157-4a55-bec0-f59444d78eba tempest-AttachVolumeTestJSON-497406096 None] Lock "cinder-7232c95a-8a10-4b47-9bde-ac5fffe5355b-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-901b8b2d-7c3a-4d4d-9cae-93a454872451" acquired by "delete_volume" :: waited 0.062s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:14 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[416c6959-b7c3-4a7c-9323-a7ae02b8d558]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:05:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:14 devstack sudo[95976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629
Sep 25 15:05:14 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:14 devstack sudo[95983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451
Sep 25 15:05:14 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:15 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629" returned: 0 in 0.977s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:15 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451" returned: 0 in 0.847s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:15 devstack sudo[95998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629
Sep 25 15:05:15 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:15 devstack sudo[95999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451
Sep 25 15:05:15 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:15 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-dab1f7b6-bb26-4ab8-8d12-db81f672b629" returned: 0 in 0.455s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Lock "cinder-quobyte-dab1f7b6-bb26-4ab8-8d12-db81f672b629" released by "delete_volume" :: held 1.596s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:16 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Created reservations ['a167ba83-5078-408e-acfd-3c83bb487332', 'bbcc6eb4-57a4-4f41-b737-d9f7cbba8b77', '6dc9f667-0ca0-4c7d-a842-ef25dfe7e9a6', 'deebcf24-eb36-4888-9468-412560b897f7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:05:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:05:16 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:05:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-901b8b2d-7c3a-4d4d-9cae-93a454872451" returned: 0 in 1.089s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:16 devstack sudo[96009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:05:16 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Lock "cinder-quobyte-901b8b2d-7c3a-4d4d-9cae-93a454872451" released by "delete_volume" :: held 2.097s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:16 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Created reservations ['8fbc8d83-c242-4e1b-84dc-13fcccad4719', '3c78447c-0f4f-4026-8224-5e578e7ed140', '293c269d-d871-4467-ace2-76e86ea36ce1', '68c3faf8-87b4-4ffc-9c81-4cb4b42ce5c7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:05:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "cinder-969381dd-6c5d-4059-bbc5-5b68c02b3aaf-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Lock "cinder-969381dd-6c5d-4059-bbc5-5b68c02b3aaf-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "cinder-quobyte-969381dd-6c5d-4059-bbc5-5b68c02b3aaf" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:05:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:05:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Lock "cinder-quobyte-969381dd-6c5d-4059-bbc5-5b68c02b3aaf" acquired by "delete_volume" :: waited 0.121s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:17 devstack sudo[96012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:05:17 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:17 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1cd0fe-182e-466f-b694-222254508d22]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:05:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:17 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 1.052s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:17 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:05:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Deleted volume successfully.
Sep 25 15:05:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1a7cf8d5-8abd-4399-91ba-ec5b813c502d tempest-AttachVolumeTestJSON-497406096 None] Lock "cinder-dab1f7b6-bb26-4ab8-8d12-db81f672b629-delete_volume" released by "delete_volume" :: held 3.642s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:17 devstack sudo[96014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf
Sep 25 15:05:17 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:17 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.695s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:17 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:05:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Deleted volume successfully.
Sep 25 15:05:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2c447d15-01b5-45c8-ab5d-21fdfc487587 tempest-VolumesGetTest-60352899 None] Lock "cinder-901b8b2d-7c3a-4d4d-9cae-93a454872451-delete_volume" released by "delete_volume" :: held 3.777s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:18 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf" returned: 0 in 1.221s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:18 devstack sudo[96021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf
Sep 25 15:05:18 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:19 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-969381dd-6c5d-4059-bbc5-5b68c02b3aaf" returned: 0 in 0.573s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Lock "cinder-quobyte-969381dd-6c5d-4059-bbc5-5b68c02b3aaf" released by "delete_volume" :: held 1.948s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:19 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Created reservations ['815d08ba-3d8c-4808-a604-4a530628a37b', '1d0e5662-a69f-4bb8-bd96-f013955aeb46', 'e7c45fbf-52bd-484a-b06a-9123c58b9f21', '5468d8a4-3f83-49cc-b658-62306f0517ce'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:05:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:05:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:05:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:19 devstack sudo[96025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:05:19 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:20 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.726s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:05:20 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Deleted volume successfully.
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Flow 'volume_create_manager' (b84af9c6-2374-44cb-9278-04c39d931a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ba5724-c1bc-422c-8599-ff84aff5336d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ba5724-c1bc-422c-8599-ff84aff5336d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2125716447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23023ac7-e8f2-4f14-87c1-707a2d9eaa1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27f4361eb9e4391a3fbbc35d4da1954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:05:20Z,use_quota=True,user_id='f2e702ebfa6c44b4a437783273d82f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (997ba561-f89d-4e4c-aca2-5b1d7d6918ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (997ba561-f89d-4e4c-aca2-5b1d7d6918ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5131bae-6201-4b92-9859-9a68a48d08bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5131bae-6201-4b92-9859-9a68a48d08bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23023ac7-e8f2-4f14-87c1-707a2d9eaa1c', 'volume_name': 'volume-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca6ee72-8190-484e-8419-434804aed9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca6ee72-8190-484e-8419-434804aed9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5de1e0-2251-44a6-8fc2-a971dee46c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:20 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Volume 23023ac7-e8f2-4f14-87c1-707a2d9eaa1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c', 'volume_size': 1}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2125716447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23023ac7-e8f2-4f14-87c1-707a2d9eaa1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27f4361eb9e4391a3fbbc35d4da1954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:05:20Z,use_quota=True,user_id='f2e702ebfa6c44b4a437783273d82f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Creating volume 23023ac7-e8f2-4f14-87c1-707a2d9eaa1c {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:05:20 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-450f5090-b105-482f-b3be-3c6a2017e120 tempest-AttachVolumeTestJSON-497406096 None] Lock "cinder-969381dd-6c5d-4059-bbc5-5b68c02b3aaf-delete_volume" released by "delete_volume" :: held 3.757s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:20 devstack sudo[96049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c 1073741824
Sep 25 15:05:20 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:20 devstack sudo[96051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:05:20 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:21 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.573s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:05:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:05:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:05:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:05:21 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c 1073741824" returned: 0 in 0.917s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:21 devstack sudo[96058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c
Sep 25 15:05:21 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:22 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c" returned: 0 in 0.463s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:05:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5de1e0-2251-44a6-8fc2-a971dee46c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff967de-480f-4459-a821-596b40eaea51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:22 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Volume volume-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c (23023ac7-e8f2-4f14-87c1-707a2d9eaa1c): created successfully
Sep 25 15:05:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff967de-480f-4459-a821-596b40eaea51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Flow 'volume_create_manager' (b84af9c6-2374-44cb-9278-04c39d931a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:05:22 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ebd295eb-b752-485c-b616-21b2ba243757 tempest-ServerRescueNegativeTestJSON-1335848613 None] Created volume successfully.
Sep 25 15:05:32 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:INSERT=16,cinder:SELECT=33,cinder:UPDATE=50,cinder:DELETE=5 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:05:32 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=38,cinder:INSERT=18,cinder:UPDATE=46,cinder:DELETE=3 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Flow 'volume_create_manager' (5079a585-52c5-4864-951d-7f8a625779fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5885a51b-3af1-4942-8700-623a696b1a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5885a51b-3af1-4942-8700-623a696b1a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1451403298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d74005-7902-4265-9553-134f8c1aa036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d96c54e02ba48f7a18270cbba5c37b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:05:40Z,use_quota=True,user_id='9f30be0711664d3bb6ecb91d58be1d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (768529ca-3d3c-4b7c-b9af-e13b37535794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (768529ca-3d3c-4b7c-b9af-e13b37535794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a04550-a4e7-44fa-996b-372a8c486392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a04550-a4e7-44fa-996b-372a8c486392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6d74005-7902-4265-9553-134f8c1aa036', 'volume_name': 'volume-e6d74005-7902-4265-9553-134f8c1aa036', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273e6bca-90f5-4590-8735-5ef08c7cb2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273e6bca-90f5-4590-8735-5ef08c7cb2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6debce-3867-4cd4-8ebf-959531f14483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:40 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Volume e6d74005-7902-4265-9553-134f8c1aa036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6d74005-7902-4265-9553-134f8c1aa036', 'volume_size': 1}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1451403298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d74005-7902-4265-9553-134f8c1aa036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d96c54e02ba48f7a18270cbba5c37b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:05:40Z,use_quota=True,user_id='9f30be0711664d3bb6ecb91d58be1d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Creating volume e6d74005-7902-4265-9553-134f8c1aa036 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:05:40 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:40 devstack sudo[96201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036 1073741824
Sep 25 15:05:40 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Acquiring lock "cinder-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Lock "cinder-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Acquiring lock "cinder-quobyte-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Lock "cinder-quobyte-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c" acquired by "delete_volume" :: waited 0.047s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:41 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d2f674-8a7b-49ab-bd02-a49bf428c559]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:05:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:41 devstack sudo[96203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c
Sep 25 15:05:41 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:42 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036 1073741824" returned: 0 in 1.339s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:42 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c" returned: 0 in 0.929s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:42 devstack sudo[96213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036
Sep 25 15:05:42 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:42 devstack sudo[96212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c
Sep 25 15:05:42 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Flow 'volume_create_manager' (b85206b1-003e-4d8d-91d4-6b7948ee6686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c2f159-dabe-40f3-9911-7c52798d3e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c2f159-dabe-40f3-9911-7c52798d3e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-178066250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7705ee9a-f046-4149-9e14-4ad4825e60d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f4f524642744628f03b21fe309fff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:05:42Z,use_quota=True,user_id='6ff18f9f830a4f79afdeaf0b7b6fcf7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b69ea1d-15d1-4df7-b361-ed131204a010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b69ea1d-15d1-4df7-b361-ed131204a010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2088e14a-36f7-4e6f-b90c-1611532eb0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2088e14a-36f7-4e6f-b90c-1611532eb0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7705ee9a-f046-4149-9e14-4ad4825e60d9', 'volume_name': 'volume-7705ee9a-f046-4149-9e14-4ad4825e60d9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf23deb1-d145-47d8-b083-0fb0c5d16bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf23deb1-d145-47d8-b083-0fb0c5d16bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5177fa-a5f2-491f-8402-bf306e162462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Volume 7705ee9a-f046-4149-9e14-4ad4825e60d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7705ee9a-f046-4149-9e14-4ad4825e60d9', 'volume_size': 1}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:42 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c" returned: 0 in 0.654s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Lock "cinder-quobyte-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c" released by "delete_volume" :: held 1.762s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Created reservations ['f43f718c-bec2-45d8-a364-86dc1a5d3b7d', 'cc19a9d3-5840-42f1-9f18-93c0d3e98235', 'd5c58afa-70a7-48a2-9b9c-59c4456191d7', 'c0106a90-eafc-4af8-96a7-bf6d40552583'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:05:42 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036" returned: 0 in 0.759s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] <== create_volume: return (2280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.283s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.361s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-178066250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7705ee9a-f046-4149-9e14-4ad4825e60d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f4f524642744628f03b21fe309fff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:05:42Z,use_quota=True,user_id='6ff18f9f830a4f79afdeaf0b7b6fcf7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Creating volume 7705ee9a-f046-4149-9e14-4ad4825e60d9 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:05:42 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7705ee9a-f046-4149-9e14-4ad4825e60d9 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6debce-3867-4cd4-8ebf-959531f14483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6d74005-7902-4265-9553-134f8c1aa036', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501250e9-e3e7-4bab-addb-318c0caaf8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:43 devstack sudo[96219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7705ee9a-f046-4149-9e14-4ad4825e60d9 1073741824
Sep 25 15:05:43 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:43 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Volume volume-e6d74005-7902-4265-9553-134f8c1aa036 (e6d74005-7902-4265-9553-134f8c1aa036): created successfully
Sep 25 15:05:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501250e9-e3e7-4bab-addb-318c0caaf8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Flow 'volume_create_manager' (5079a585-52c5-4864-951d-7f8a625779fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:05:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:05:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:05:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:43 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-5f64b1b8-5ba2-48b9-90da-e0d2bacfa53f req-b85e4bc6-13b1-4295-857d-79d3fc6096fd tempest-VolumesSnapshotsTestJSON-1395915021 None] Created volume successfully.
Sep 25 15:05:43 devstack sudo[96221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:05:43 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:43 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.623s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:43 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:05:43 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Deleted volume successfully.
Sep 25 15:05:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a068cfc-3322-4931-a92f-77c8a58c0f20 tempest-ServerRescueNegativeTestJSON-1335848613 None] Lock "cinder-23023ac7-e8f2-4f14-87c1-707a2d9eaa1c-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:44 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7705ee9a-f046-4149-9e14-4ad4825e60d9 1073741824" returned: 0 in 1.319s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7705ee9a-f046-4149-9e14-4ad4825e60d9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:44 devstack sudo[96236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7705ee9a-f046-4149-9e14-4ad4825e60d9
Sep 25 15:05:44 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:45 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7705ee9a-f046-4149-9e14-4ad4825e60d9" returned: 0 in 0.817s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] <== create_volume: return (2245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:05:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.254s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.605s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5177fa-a5f2-491f-8402-bf306e162462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7705ee9a-f046-4149-9e14-4ad4825e60d9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3918ddb1-9b64-4fb7-b334-05a8a675ce72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:05:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] Creating offline snapshot e6a5a925-38af-4d10-9ba4-a9d0e193e777 of volume e6d74005-7902-4265-9553-134f8c1aa036 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:05:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Volume volume-7705ee9a-f046-4149-9e14-4ad4825e60d9 (7705ee9a-f046-4149-9e14-4ad4825e60d9): created successfully
Sep 25 15:05:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3918ddb1-9b64-4fb7-b334-05a8a675ce72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:05:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Flow 'volume_create_manager' (b85206b1-003e-4d8d-91d4-6b7948ee6686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:05:45 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b373b5d-7728-47d8-89b1-9c3659b8b333]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:05:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-24b84260-ed02-4890-a485-5b06df00456b tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Created volume successfully.
Sep 25 15:05:45 devstack sudo[96258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036
Sep 25 15:05:45 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:45 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036" returned: 0 in 0.670s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:46 devstack sudo[96264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777 1G
Sep 25 15:05:46 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:46 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777 1G" returned: 0 in 0.635s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d74005-7902-4265-9553-134f8c1aa036 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:46 devstack sudo[96270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d74005-7902-4265-9553-134f8c1aa036 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777
Sep 25 15:05:46 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:47 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6d74005-7902-4265-9553-134f8c1aa036 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777" returned: 0 in 0.765s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:47 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777 is being set with open permissions: ugo+rw
Sep 25 15:05:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:47 devstack sudo[96277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777
Sep 25 15:05:47 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:47 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777" returned: 0 in 0.588s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:48 devstack sudo[96281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.info
Sep 25 15:05:48 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Acquiring lock "cinder-7705ee9a-f046-4149-9e14-4ad4825e60d9-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:48 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Lock "cinder-7705ee9a-f046-4149-9e14-4ad4825e60d9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.info" returned: 0 in 0.617s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:48 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.info is being set with open permissions: ugo+rw
Sep 25 15:05:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:48 devstack sudo[96284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.info
Sep 25 15:05:48 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Acquiring lock "cinder-quobyte-7705ee9a-f046-4149-9e14-4ad4825e60d9" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Lock "cinder-quobyte-7705ee9a-f046-4149-9e14-4ad4825e60d9" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[623bf25c-65e7-4879-8750-c4ccd84643e3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:05:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7705ee9a-f046-4149-9e14-4ad4825e60d9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:49 devstack sudo[96286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7705ee9a-f046-4149-9e14-4ad4825e60d9
Sep 25 15:05:49 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:49 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.info" returned: 0 in 0.464s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.023s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-e30e2e51-7a72-4985-8d61-450cd2ebd34e req-ea02e7c7-4f87-45b1-a9fc-31f6c05e1b1b tempest-VolumesSnapshotsTestJSON-1395915021 None] Create snapshot completed successfully
Sep 25 15:05:49 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7705ee9a-f046-4149-9e14-4ad4825e60d9" returned: 0 in 0.686s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7705ee9a-f046-4149-9e14-4ad4825e60d9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:49 devstack sudo[96294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7705ee9a-f046-4149-9e14-4ad4825e60d9
Sep 25 15:05:49 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:50 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7705ee9a-f046-4149-9e14-4ad4825e60d9" returned: 0 in 0.638s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Lock "cinder-quobyte-7705ee9a-f046-4149-9e14-4ad4825e60d9" released by "delete_volume" :: held 1.427s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Acquiring lock "cinder-e6a5a925-38af-4d10-9ba4-a9d0e193e777-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "cinder-e6a5a925-38af-4d10-9ba4-a9d0e193e777-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Acquiring lock "cinder-quobyte-e6d74005-7902-4265-9553-134f8c1aa036" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "cinder-quobyte-e6d74005-7902-4265-9553-134f8c1aa036" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Acquiring lock "cinder-quobyte-e6a5a925-38af-4d10-9ba4-a9d0e193e777" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "cinder-quobyte-e6a5a925-38af-4d10-9ba4-a9d0e193e777" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Deleting offline snapshot e6a5a925-38af-4d10-9ba4-a9d0e193e777 of volume e6d74005-7902-4265-9553-134f8c1aa036 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] snapshot_file for this snap is: volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7df08a-fc85-441a-a8a4-2493c4b2161f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Created reservations ['a497ef09-88f3-46ab-beb2-c6e3d002d95a', 'c392f4b6-e8ec-40b6-9ec1-a288adccc914', '55f7c65b-72f3-4597-98c6-a5808bd2279b', 'ac524fc1-bbba-46b3-9bad-0197d79aaca6'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:05:50 devstack sudo[96320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777
Sep 25 15:05:50 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:50 devstack sudo[96322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:05:50 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:51 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777" returned: 0 in 0.671s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6d74005-7902-4265-9553-134f8c1aa036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:05:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f7984f-66e6-4b03-bdf6-083eb5ec8826]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:05:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:51 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.583s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:51 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:05:51 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Deleted volume successfully.
Sep 25 15:05:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6c7e0cc7-2ccf-433b-bfe7-ef6848741422 tempest-VolumeQuotasNegativeTestJSON-1586473796 None] Lock "cinder-7705ee9a-f046-4149-9e14-4ad4825e60d9-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:51 devstack sudo[96329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036
Sep 25 15:05:51 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:51 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036" returned: 0 in 0.652s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:51 devstack sudo[96336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777
Sep 25 15:05:51 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:52 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777" returned: 0 in 0.538s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:52 devstack sudo[96342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777
Sep 25 15:05:52 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:52 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036.e6a5a925-38af-4d10-9ba4-a9d0e193e777" returned: 0 in 0.417s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "cinder-quobyte-e6a5a925-38af-4d10-9ba4-a9d0e193e777" released by "_delete_snapshot" :: held 2.480s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "cinder-quobyte-e6d74005-7902-4265-9553-134f8c1aa036" released by "delete_snapshot" :: held 2.527s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:53 devstack cinder-volume[87071]: DEBUG cinder.quota [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Created reservations ['17836953-9a4f-4fdc-a347-9d6b6cf8f429', 'b98f4184-79da-40ef-b48e-8082c16f711e', '0bcc0e44-b989-41c4-86bc-8bcc04ce6505', 'aab752cf-68fc-45c2-b108-cb289765bfdc'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:05:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Delete snapshot completed successfully.
Sep 25 15:05:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-896a7d6c-add3-42ae-a6ff-c608c0a5514b req-a2889806-73e5-44b0-b6a5-59e4662ebf91 tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "cinder-e6a5a925-38af-4d10-9ba4-a9d0e193e777-delete_snapshot" released by "delete_snapshot" :: held 2.773s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Acquiring lock "cinder-e6d74005-7902-4265-9553-134f8c1aa036-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "cinder-e6d74005-7902-4265-9553-134f8c1aa036-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Acquiring lock "cinder-quobyte-e6d74005-7902-4265-9553-134f8c1aa036" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:05:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "cinder-quobyte-e6d74005-7902-4265-9553-134f8c1aa036" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:05:54 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57855d8-8ce2-4669-8897-73732b272491]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:05:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:54 devstack sudo[96387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036
Sep 25 15:05:54 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:54 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036" returned: 0 in 0.568s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:54 devstack sudo[96394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036
Sep 25 15:05:54 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:55 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e6d74005-7902-4265-9553-134f8c1aa036" returned: 0 in 0.345s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "cinder-quobyte-e6d74005-7902-4265-9553-134f8c1aa036" released by "delete_volume" :: held 1.067s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:05:55 devstack cinder-volume[87071]: DEBUG cinder.quota [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Created reservations ['27fff92e-63ff-4874-bfa0-550182ed433b', '8f7f9af8-88c8-4bc6-9dc4-d564b29f3ce6', '7102af04-8870-4acd-89fd-e4cc711e6f7b', '1ee0db2c-d234-46f8-876b-33d4a501364e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:05:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:05:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:05:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:05:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:05:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:05:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:05:55 devstack sudo[96398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:05:55 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:05:55 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root
Sep 25 15:05:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.301s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:05:55 devstack cinder-volume[87071]: DEBUG cinder.manager [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:05:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Deleted volume successfully.
Sep 25 15:05:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-3de33acb-5ea2-4cee-8549-7d0d03af6705 req-6c6d753a-c3f6-489a-bb15-17272a43110f tempest-VolumesSnapshotsTestJSON-1395915021 None] Lock "cinder-e6d74005-7902-4265-9553-134f8c1aa036-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:06:05 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=28,cinder:UPDATE=33,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:06:05 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=41,cinder:SELECT=28,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:06:07 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-185c4996-c4f4-4bee-b61c-7d3bbf6c1a60 tempest-GroupSnapshotsTest-1089396811 None] Group tempest-GroupSnapshotsTest-Group-1626718911: creating
Sep 25 15:06:07 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-185c4996-c4f4-4bee-b61c-7d3bbf6c1a60 tempest-GroupSnapshotsTest-1089396811 None] Group tempest-GroupSnapshotsTest-Group-1626718911: created successfully
Sep 25 15:06:07 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-185c4996-c4f4-4bee-b61c-7d3bbf6c1a60 tempest-GroupSnapshotsTest-1089396811 None] Create group completed successfully.
Sep 25 15:06:08 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:06:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Flow 'volume_create_manager' (12b0130b-39e7-423d-90e2-44827238c890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:06:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e06fcd4-4cbb-43a7-8d6b-6fc03d5507dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e06fcd4-4cbb-43a7-8d6b-6fc03d5507dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-363263931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d9006c-b7f8-4370-bd16-6c4d02e9a0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6911cded11e429a8586925c5352636b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:06:09Z,use_quota=True,user_id='1751fa3e3b0841d7967e1c6f07f4df9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0067a685-8ec3-4b9f-a822-b906faae64d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0067a685-8ec3-4b9f-a822-b906faae64d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (528faf51-a162-4e9f-b4da-4da6970fe8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (528faf51-a162-4e9f-b4da-4da6970fe8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72d9006c-b7f8-4370-bd16-6c4d02e9a0b8', 'volume_name': 'volume-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf827a1-deed-4ad4-9aca-b0ffd654a1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf827a1-deed-4ad4-9aca-b0ffd654a1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22e981d-f4ba-474d-92c7-b233d7317c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:09 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Volume 72d9006c-b7f8-4370-bd16-6c4d02e9a0b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8', 'volume_size': 1}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-363263931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d9006c-b7f8-4370-bd16-6c4d02e9a0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6911cded11e429a8586925c5352636b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:06:09Z,use_quota=True,user_id='1751fa3e3b0841d7967e1c6f07f4df9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Creating volume 72d9006c-b7f8-4370-bd16-6c4d02e9a0b8 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:06:09 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:09 devstack sudo[96407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8 1073741824
Sep 25 15:06:09 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Flow 'volume_create_manager' (827a8460-1532-4d25-a13b-97073b9dd9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663b3133-5bf6-4208-befd-eb41617b64e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663b3133-5bf6-4208-befd-eb41617b64e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2112923865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=645bedb0-184d-4f70-992c-a9a10746948b,host='devstack@QuobyteHD#QuobyteHD',id=034338fa-9dc5-4352-bfc9-9009e5a29a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73b76d1f9da4f9196f86496c58aa584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:06:09Z,use_quota=True,user_id='da74994d182d480a90f0f6a230f44dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(504e49f2-46d9-4ce4-9751-49c0ab2fd8e0),volume_type_id=504e49f2-46d9-4ce4-9751-49c0ab2fd8e0)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e86556b-a52a-4598-a7a1-d04468efcfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e86556b-a52a-4598-a7a1-d04468efcfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f97268-880d-4708-9207-3929479f6048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f97268-880d-4708-9207-3929479f6048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '034338fa-9dc5-4352-bfc9-9009e5a29a32', 'volume_name': 'volume-034338fa-9dc5-4352-bfc9-9009e5a29a32', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa60b731-e84b-4083-8e4d-7566a296db6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa60b731-e84b-4083-8e4d-7566a296db6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b91820-fa9d-444b-b612-4aa813a5ea1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:09 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Volume 034338fa-9dc5-4352-bfc9-9009e5a29a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-034338fa-9dc5-4352-bfc9-9009e5a29a32', 'volume_size': 1}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:09 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8 1073741824" returned: 0 in 0.751s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:09 devstack sudo[96415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8
Sep 25 15:06:09 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:10 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8" returned: 0 in 0.309s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.677s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=645bedb0-184d-4f70-992c-a9a10746948b,created_at=2026-09-25T13:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2112923865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=645bedb0-184d-4f70-992c-a9a10746948b,host='devstack@QuobyteHD#QuobyteHD',id=034338fa-9dc5-4352-bfc9-9009e5a29a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73b76d1f9da4f9196f86496c58aa584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:06:09Z,use_quota=True,user_id='da74994d182d480a90f0f6a230f44dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(504e49f2-46d9-4ce4-9751-49c0ab2fd8e0),volume_type_id=504e49f2-46d9-4ce4-9751-49c0ab2fd8e0)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Creating volume 034338fa-9dc5-4352-bfc9-9009e5a29a32 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:06:10 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22e981d-f4ba-474d-92c7-b233d7317c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:10 devstack sudo[96418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 1073741824
Sep 25 15:06:10 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8dac7b-68cb-464c-bfad-bc4a6a8bc643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:10 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Volume volume-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8 (72d9006c-b7f8-4370-bd16-6c4d02e9a0b8): created successfully
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8dac7b-68cb-464c-bfad-bc4a6a8bc643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Flow 'volume_create_manager' (12b0130b-39e7-423d-90e2-44827238c890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:06:10 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-06a8cfbf-8b48-4890-8f54-d9418fe1b255 tempest-VolumesServicesTestJSON-371405643 None] Created volume successfully.
Sep 25 15:06:11 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 1073741824" returned: 0 in 0.758s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:11 devstack sudo[96423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32
Sep 25 15:06:11 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Acquiring lock "cinder-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:06:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Lock "cinder-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:06:11 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32" returned: 0 in 0.459s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:06:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Acquiring lock "cinder-quobyte-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:06:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Lock "cinder-quobyte-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:06:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b91820-fa9d-444b-b612-4aa813a5ea1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-034338fa-9dc5-4352-bfc9-9009e5a29a32', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1789f79a-4f99-4cde-ad26-588d5f153203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c60a3c0-8406-421f-9e52-a2f93d79a674]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:06:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:11 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Volume volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 (034338fa-9dc5-4352-bfc9-9009e5a29a32): created successfully
Sep 25 15:06:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1789f79a-4f99-4cde-ad26-588d5f153203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Flow 'volume_create_manager' (827a8460-1532-4d25-a13b-97073b9dd9c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:06:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a4cdb360-6fae-4af7-b345-d8c80122991a tempest-GroupSnapshotsTest-1089396811 None] Created volume successfully.
Sep 25 15:06:11 devstack sudo[96428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8
Sep 25 15:06:11 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:12 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8" returned: 0 in 0.686s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:12 devstack sudo[96433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8
Sep 25 15:06:12 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] GroupSnapshot fa7a9e90-db9c-41ae-870a-f2173b952602: creating.
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] Group snapshot fa7a9e90-db9c-41ae-870a-f2173b952602: creating. {{(pid=87071) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] Creating offline snapshot 51ad5d8f-385d-4d9d-9816-190f0fe7c837 of volume 034338fa-9dc5-4352-bfc9-9009e5a29a32 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5ff30e-f7f9-498f-b012-d6e55d885f2e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:12 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8" returned: 0 in 0.383s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Lock "cinder-quobyte-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8" released by "delete_volume" :: held 1.144s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Created reservations ['61daac98-010d-42eb-8613-d5b860ea0d25', '2af51ec9-6da8-43ed-98eb-9402b648fa65', '2abfdfc0-47d8-4068-9d1a-e8b88a341b00', '77610f04-c41e-4f44-a34a-71302a1bc1ed'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:06:12 devstack sudo[96436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32
Sep 25 15:06:12 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:13 devstack sudo[96438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:06:13 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:13 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32" returned: 0 in 0.560s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:13 devstack sudo[96446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837 1G
Sep 25 15:06:13 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:13 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.354s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:06:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Deleted volume successfully.
Sep 25 15:06:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4888f28-b818-4a90-908e-6d92470ffb6a tempest-VolumesServicesTestJSON-371405643 None] Lock "cinder-72d9006c-b7f8-4370-bd16-6c4d02e9a0b8-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:06:13 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837 1G" returned: 0 in 0.650s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:13 devstack sudo[96454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837
Sep 25 15:06:13 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:14 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837" returned: 0 in 0.438s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:14 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 15:06:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:14 devstack sudo[96460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837
Sep 25 15:06:14 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:14 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837" returned: 0 in 0.371s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:14 devstack sudo[96463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.info
Sep 25 15:06:14 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:15 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.info" returned: 0 in 0.386s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:15 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 15:06:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:15 devstack sudo[96466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.info
Sep 25 15:06:15 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:15 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.info" returned: 0 in 0.435s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.977s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d9592e8b-d528-4955-8463-3b0f21fd0013 tempest-GroupSnapshotsTest-1089396811 None] group_snapshot fa7a9e90-db9c-41ae-870a-f2173b952602: created successfully
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "cinder-quobyte-51ad5d8f-385d-4d9d-9816-190f0fe7c837-813fc86f-c2db-406f-a683-f5de07997aca" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-51ad5d8f-385d-4d9d-9816-190f0fe7c837-813fc86f-c2db-406f-a683-f5de07997aca" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Creating volume 813fc86f-c2db-406f-a683-f5de07997aca from snapshot 51ad5d8f-385d-4d9d-9816-190f0fe7c837 {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "cinder-quobyte-813fc86f-c2db-406f-a683-f5de07997aca" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-813fc86f-c2db-406f-a683-f5de07997aca" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] snapshot: 51ad5d8f-385d-4d9d-9816-190f0fe7c837, volume: 813fc86f-c2db-406f-a683-f5de07997aca,  {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f123e6c1-7f70-4761-8dd0-3131e24ec4d1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:06:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:17 devstack sudo[96482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837
Sep 25 15:06:17 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:18 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837" returned: 0 in 0.781s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034338fa-9dc5-4352-bfc9-9009e5a29a32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:06:18 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a6cf1a-a142-42e0-b493-880b1626ec4b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:06:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:18 devstack sudo[96493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32
Sep 25 15:06:18 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:18 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32" returned: 0 in 0.564s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 15:06:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 15:06:18 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Path /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-813fc86f-c2db-406f-a683-f5de07997aca not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 15:06:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-813fc86f-c2db-406f-a683-f5de07997aca {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:18 devstack sudo[96510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-813fc86f-c2db-406f-a683-f5de07997aca
Sep 25 15:06:18 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:06:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:06:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:06:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:20 devstack sudo[96522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:06:20 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:21 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.564s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:06:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:06:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:06:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:06:27 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=19,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:06:27 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=19,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:06:27 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-813fc86f-c2db-406f-a683-f5de07997aca" returned: 0 in 9.286s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:27 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Image conversion details: src /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32, size 1024.00 MB, duration 9.29 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-813fc86f-c2db-406f-a683-f5de07997aca {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:06:27 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Converted 1024.00 MB image at 110.20 MB/s
Sep 25 15:06:27 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-813fc86f-c2db-406f-a683-f5de07997aca is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 15:06:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-813fc86f-c2db-406f-a683-f5de07997aca {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:28 devstack sudo[96528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-813fc86f-c2db-406f-a683-f5de07997aca
Sep 25 15:06:28 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:28 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-813fc86f-c2db-406f-a683-f5de07997aca" returned: 0 in 0.373s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-813fc86f-c2db-406f-a683-f5de07997aca" released by "_copy_volume_from_snapshot" :: held 11.169s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:06:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-51ad5d8f-385d-4d9d-9816-190f0fe7c837-813fc86f-c2db-406f-a683-f5de07997aca" released by "_create_volume_from_snapshot" :: held 11.285s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:06:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.317s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-51f1232f-e48a-42ba-8188-4429fbdc09d5 tempest-GroupSnapshotsTest-1089396811 None] Create group from source-snapshot-fa7a9e90-db9c-41ae-870a-f2173b952602 completed successfully.
Sep 25 15:06:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "cinder-quobyte-813fc86f-c2db-406f-a683-f5de07997aca" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:06:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-813fc86f-c2db-406f-a683-f5de07997aca" acquired by "delete_volume" :: waited 0.045s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:06:30 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea77a2f-2141-4327-a4e5-2ff0213d4877]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:06:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-813fc86f-c2db-406f-a683-f5de07997aca {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:30 devstack sudo[96588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-813fc86f-c2db-406f-a683-f5de07997aca
Sep 25 15:06:30 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:30 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-813fc86f-c2db-406f-a683-f5de07997aca" returned: 0 in 0.750s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-813fc86f-c2db-406f-a683-f5de07997aca {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:30 devstack sudo[96616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-813fc86f-c2db-406f-a683-f5de07997aca
Sep 25 15:06:30 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:31 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-813fc86f-c2db-406f-a683-f5de07997aca" returned: 0 in 0.439s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-813fc86f-c2db-406f-a683-f5de07997aca" released by "delete_volume" :: held 1.336s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:06:31 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Created reservations ['108dba99-4c89-4397-a5bc-a8576accc421'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:06:31 devstack cinder-volume[87071]: WARNING cinder.quota [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2005128906 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2005128906, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:06:31 devstack cinder-volume[87071]: WARNING cinder.quota [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2005128906 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2005128906, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:06:31 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Created reservations ['abbd1534-04c9-483a-a65d-230a67e6b5a8', 'adaa575b-7456-4268-bbdf-9add0829b30d', '4b71e1d6-6559-45ef-9e96-348fe8244fd4', '3685c2a2-00a3-413c-a920-120cc70260cc'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:06:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:06:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:06:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:31 devstack sudo[96620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:06:31 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:32 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.434s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:32 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:06:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-cfcfbe5c-9a82-4fc2-8b41-41f20ad3e158 tempest-GroupSnapshotsTest-1089396811 None] Delete group completed successfully.
Sep 25 15:06:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] group_snapshot fa7a9e90-db9c-41ae-870a-f2173b952602: deleting
Sep 25 15:06:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] group_snapshot fa7a9e90-db9c-41ae-870a-f2173b952602: deleting {{(pid=87071) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 25 15:06:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "cinder-quobyte-034338fa-9dc5-4352-bfc9-9009e5a29a32" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:06:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-034338fa-9dc5-4352-bfc9-9009e5a29a32" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:06:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "cinder-quobyte-51ad5d8f-385d-4d9d-9816-190f0fe7c837" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:06:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-51ad5d8f-385d-4d9d-9816-190f0fe7c837" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:06:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] Deleting offline snapshot 51ad5d8f-385d-4d9d-9816-190f0fe7c837 of volume 034338fa-9dc5-4352-bfc9-9009e5a29a32 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:06:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] snapshot_file for this snap is: volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:06:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea5ed58-d7d2-4723-b4fb-fd59d2d0a1d4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:06:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:33 devstack sudo[96628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837
Sep 25 15:06:33 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:34 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837" returned: 0 in 0.752s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034338fa-9dc5-4352-bfc9-9009e5a29a32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:06:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea268f3e-e217-4d28-a2c0-f30bd8d5ef29]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:06:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:34 devstack sudo[96634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32
Sep 25 15:06:34 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:35 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32" returned: 0 in 0.967s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:35 devstack sudo[96640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837
Sep 25 15:06:35 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:36 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837" returned: 0 in 1.030s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:36 devstack sudo[96645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837
Sep 25 15:06:36 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Flow 'volume_create_manager' (7f4ade2e-848b-4df3-84d7-2e4a75af5069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53046491-5fe4-4503-98a9-7fc4d9732eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53046491-5fe4-4503-98a9-7fc4d9732eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1986462347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279e5b3e-d550-4370-a9e2-d00eee477ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7b0c027a8447d1b704b2bcfe82f034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:06:36Z,use_quota=True,user_id='109005d02b824978a919664f53788f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf7ed7d-0694-4b4d-8f74-3329ae29cf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf7ed7d-0694-4b4d-8f74-3329ae29cf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10c8215-29d6-4628-938f-a99fbca6b090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10c8215-29d6-4628-938f-a99fbca6b090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279e5b3e-d550-4370-a9e2-d00eee477ba5', 'volume_name': 'volume-279e5b3e-d550-4370-a9e2-d00eee477ba5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381e1891-1e2e-4efa-8b0c-a9e5f6a29560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381e1891-1e2e-4efa-8b0c-a9e5f6a29560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8570c11b-051e-42c4-b3e7-5ca2aaf904e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:36 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Volume 279e5b3e-d550-4370-a9e2-d00eee477ba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279e5b3e-d550-4370-a9e2-d00eee477ba5', 'volume_size': 1}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1986462347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279e5b3e-d550-4370-a9e2-d00eee477ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7b0c027a8447d1b704b2bcfe82f034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:06:36Z,use_quota=True,user_id='109005d02b824978a919664f53788f36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Creating volume 279e5b3e-d550-4370-a9e2-d00eee477ba5 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:06:36 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-279e5b3e-d550-4370-a9e2-d00eee477ba5 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:36 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:36 devstack sudo[96649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-279e5b3e-d550-4370-a9e2-d00eee477ba5 1073741824
Sep 25 15:06:36 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32.51ad5d8f-385d-4d9d-9816-190f0fe7c837" returned: 0 in 0.625s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-51ad5d8f-385d-4d9d-9816-190f0fe7c837" released by "_delete_snapshot" :: held 3.687s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:06:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-034338fa-9dc5-4352-bfc9-9009e5a29a32" released by "delete_snapshot" :: held 3.766s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:06:37 devstack cinder-volume[87071]: WARNING cinder.quota [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2005128906 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2005128906, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:06:37 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] Created reservations ['b48deda1-b637-4845-ba0d-5e538ce17907', '95e1f90e-e778-42d5-8d4a-e8b4e7f8809a', '94544872-1101-4ead-95b0-64d41f19992c', 'ddc40ca6-0bfc-43d0-bb01-9d94f61a8427'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:06:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-11ae2f9f-7960-4299-b16c-2a1728bc1e3e tempest-GroupSnapshotsTest-1089396811 None] group_snapshot fa7a9e90-db9c-41ae-870a-f2173b952602: deleted successfully
Sep 25 15:06:37 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-279e5b3e-d550-4370-a9e2-d00eee477ba5 1073741824" returned: 0 in 0.816s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-279e5b3e-d550-4370-a9e2-d00eee477ba5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:37 devstack sudo[96667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-279e5b3e-d550-4370-a9e2-d00eee477ba5
Sep 25 15:06:37 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:38 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-279e5b3e-d550-4370-a9e2-d00eee477ba5" returned: 0 in 0.726s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:06:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8570c11b-051e-42c4-b3e7-5ca2aaf904e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279e5b3e-d550-4370-a9e2-d00eee477ba5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cee75d-6761-4fdb-a723-d7bd4f7750ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:38 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Volume volume-279e5b3e-d550-4370-a9e2-d00eee477ba5 (279e5b3e-d550-4370-a9e2-d00eee477ba5): created successfully
Sep 25 15:06:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cee75d-6761-4fdb-a723-d7bd4f7750ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Flow 'volume_create_manager' (7f4ade2e-848b-4df3-84d7-2e4a75af5069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:06:38 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8959927d-ef0d-4954-a9be-1fa8fc4730a9 tempest-TestMinimumBasicScenario-280967217 None] Created volume successfully.
Sep 25 15:06:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "cinder-quobyte-034338fa-9dc5-4352-bfc9-9009e5a29a32" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:06:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-034338fa-9dc5-4352-bfc9-9009e5a29a32" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:06:38 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83b8f58-98f4-4fdc-b9bb-31c068aed117]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:06:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:38 devstack sudo[96674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32
Sep 25 15:06:39 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:39 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32" returned: 0 in 0.641s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:39 devstack sudo[96680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32
Sep 25 15:06:39 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:40 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-034338fa-9dc5-4352-bfc9-9009e5a29a32" returned: 0 in 0.692s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-034338fa-9dc5-4352-bfc9-9009e5a29a32" released by "delete_volume" :: held 1.485s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:06:40 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] Created reservations ['bed43b8d-c8a2-43b3-bad3-ee5521b1420c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:06:40 devstack cinder-volume[87071]: WARNING cinder.db.api [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2005128906']
Sep 25 15:06:40 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] Created reservations ['e807fc8f-7cd3-4ed0-98ec-38a0bfa79a56', 'f809a21c-3c0a-4391-a0c8-fb389e774f6d', 'adb6d49e-4620-438b-bfc9-44db054dbac7', '7d45a5ef-15b5-4e52-8625-5ac17780383f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:06:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:06:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:06:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:41 devstack sudo[96687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:06:41 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:41 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.508s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:41 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:06:41 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ea80c382-7543-4790-b83e-c121cee2c40b tempest-GroupSnapshotsTest-1089396811 None] Delete group completed successfully.
Sep 25 15:06:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-07ef0fd0-a0c3-4118-82fe-a59b602c81f3 req-8f6b0c83-d578-47ca-a897-6f03075b5fc0 tempest-TestMinimumBasicScenario-280967217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-07ef0fd0-a0c3-4118-82fe-a59b602c81f3 req-8f6b0c83-d578-47ca-a897-6f03075b5fc0 tempest-TestMinimumBasicScenario-280967217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-07ef0fd0-a0c3-4118-82fe-a59b602c81f3 req-8f6b0c83-d578-47ca-a897-6f03075b5fc0 tempest-TestMinimumBasicScenario-280967217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-07ef0fd0-a0c3-4118-82fe-a59b602c81f3 req-8f6b0c83-d578-47ca-a897-6f03075b5fc0 tempest-TestMinimumBasicScenario-280967217 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-279e5b3e-d550-4370-a9e2-d00eee477ba5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d91e54b-9b60-4213-a570-4841737a4750', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:06:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-07ef0fd0-a0c3-4118-82fe-a59b602c81f3 req-8f6b0c83-d578-47ca-a897-6f03075b5fc0 tempest-TestMinimumBasicScenario-280967217 None] attachment_update completed successfully.
Sep 25 15:06:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7bbc7941-6694-4956-9db9-c642fe39ab40 tempest-GroupSnapshotsTest-1089396811 None] Group tempest-GroupSnapshotsTest-Group-1028099006: creating
Sep 25 15:06:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7bbc7941-6694-4956-9db9-c642fe39ab40 tempest-GroupSnapshotsTest-1089396811 None] Group tempest-GroupSnapshotsTest-Group-1028099006: created successfully
Sep 25 15:06:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7bbc7941-6694-4956-9db9-c642fe39ab40 tempest-GroupSnapshotsTest-1089396811 None] Create group completed successfully.
Sep 25 15:06:45 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:06:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Flow 'volume_create_manager' (864b83c3-00ef-4b44-a663-063c4449e9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:06:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9372379-b75a-485b-b0dc-0358a3c06cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9372379-b75a-485b-b0dc-0358a3c06cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1850636078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6cd497f8-e3e1-409e-aa11-ed4925e5fc70,host='devstack@QuobyteHD#QuobyteHD',id=534c12bf-d23c-45ae-a820-a891ea83d794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73b76d1f9da4f9196f86496c58aa584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:06:46Z,use_quota=True,user_id='da74994d182d480a90f0f6a230f44dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(391dda73-d0ba-4b52-8ef7-0ab625e3796c),volume_type_id=391dda73-d0ba-4b52-8ef7-0ab625e3796c)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96065f76-d337-47e5-9856-b135936e626c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96065f76-d337-47e5-9856-b135936e626c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b90ff7-202b-4045-a779-3c34cabfbe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b90ff7-202b-4045-a779-3c34cabfbe9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '534c12bf-d23c-45ae-a820-a891ea83d794', 'volume_name': 'volume-534c12bf-d23c-45ae-a820-a891ea83d794', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (731121ef-4cc3-4268-a12d-0f451827755b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (731121ef-4cc3-4268-a12d-0f451827755b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0785179-d9a5-45f2-9ab9-8911f2d9ca15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:46 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Volume 534c12bf-d23c-45ae-a820-a891ea83d794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-534c12bf-d23c-45ae-a820-a891ea83d794', 'volume_size': 1}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6cd497f8-e3e1-409e-aa11-ed4925e5fc70,created_at=2026-09-25T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1850636078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6cd497f8-e3e1-409e-aa11-ed4925e5fc70,host='devstack@QuobyteHD#QuobyteHD',id=534c12bf-d23c-45ae-a820-a891ea83d794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73b76d1f9da4f9196f86496c58aa584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:06:46Z,use_quota=True,user_id='da74994d182d480a90f0f6a230f44dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(391dda73-d0ba-4b52-8ef7-0ab625e3796c),volume_type_id=391dda73-d0ba-4b52-8ef7-0ab625e3796c)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Creating volume 534c12bf-d23c-45ae-a820-a891ea83d794 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:06:46 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:46 devstack sudo[97195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794 1073741824
Sep 25 15:06:46 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:46 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794 1073741824" returned: 0 in 0.904s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:47 devstack sudo[97222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794
Sep 25 15:06:47 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:47 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794" returned: 0 in 0.875s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:06:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0785179-d9a5-45f2-9ab9-8911f2d9ca15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-534c12bf-d23c-45ae-a820-a891ea83d794', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9809d856-a850-486d-a6a2-234275e1aa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:48 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Volume volume-534c12bf-d23c-45ae-a820-a891ea83d794 (534c12bf-d23c-45ae-a820-a891ea83d794): created successfully
Sep 25 15:06:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9809d856-a850-486d-a6a2-234275e1aa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Flow 'volume_create_manager' (864b83c3-00ef-4b44-a663-063c4449e9e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:06:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c5795e6f-eeac-491e-aeba-2e505b2c9f83 tempest-GroupSnapshotsTest-1089396811 None] Created volume successfully.
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Flow 'volume_create_manager' (da072b34-b961-4487-b7f2-38e475846df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331c14a9-fb16-4e61-b7f2-97b9e919ad75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331c14a9-fb16-4e61-b7f2-97b9e919ad75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-575208551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6cd497f8-e3e1-409e-aa11-ed4925e5fc70,host='devstack@QuobyteHD#QuobyteHD',id=9549aa47-49bc-4e0d-b9d9-0c400c90d53b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73b76d1f9da4f9196f86496c58aa584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:06:50Z,use_quota=True,user_id='da74994d182d480a90f0f6a230f44dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(391dda73-d0ba-4b52-8ef7-0ab625e3796c),volume_type_id=391dda73-d0ba-4b52-8ef7-0ab625e3796c)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e7ed48-cf9c-4019-8d07-362167d48ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e7ed48-cf9c-4019-8d07-362167d48ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09103ee-8684-41bc-aac3-cf7a724ab60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09103ee-8684-41bc-aac3-cf7a724ab60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9549aa47-49bc-4e0d-b9d9-0c400c90d53b', 'volume_name': 'volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f819881-2248-41a3-a0a5-649cfcb94e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f819881-2248-41a3-a0a5-649cfcb94e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c5c213-fc70-49d7-9730-98c127592c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:50 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Volume 9549aa47-49bc-4e0d-b9d9-0c400c90d53b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b', 'volume_size': 1}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6cd497f8-e3e1-409e-aa11-ed4925e5fc70,created_at=2026-09-25T13:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-575208551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6cd497f8-e3e1-409e-aa11-ed4925e5fc70,host='devstack@QuobyteHD#QuobyteHD',id=9549aa47-49bc-4e0d-b9d9-0c400c90d53b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73b76d1f9da4f9196f86496c58aa584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:06:50Z,use_quota=True,user_id='da74994d182d480a90f0f6a230f44dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(391dda73-d0ba-4b52-8ef7-0ab625e3796c),volume_type_id=391dda73-d0ba-4b52-8ef7-0ab625e3796c)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Creating volume 9549aa47-49bc-4e0d-b9d9-0c400c90d53b {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:06:50 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:06:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:50 devstack sudo[97249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b 1073741824
Sep 25 15:06:50 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:51 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b 1073741824" returned: 0 in 1.025s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:51 devstack sudo[97255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b
Sep 25 15:06:51 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:51 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b" returned: 0 in 0.407s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:06:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c5c213-fc70-49d7-9730-98c127592c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb299d1-ce8c-48ad-9927-fca8c1e630ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:51 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Volume volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b (9549aa47-49bc-4e0d-b9d9-0c400c90d53b): created successfully
Sep 25 15:06:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb299d1-ce8c-48ad-9927-fca8c1e630ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Flow 'volume_create_manager' (da072b34-b961-4487-b7f2-38e475846df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:06:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8f3a24ed-60d0-44da-868c-da7361b3892c tempest-GroupSnapshotsTest-1089396811 None] Created volume successfully.
Sep 25 15:06:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-abe4e8fa-1a44-403a-92ba-ad33837b065f tempest-GroupSnapshotsTest-1089396811 None] Update group completed successfully.
Sep 25 15:06:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f82899e6-5445-4c82-a8c4-ce54a06b41ab tempest-GroupSnapshotsTest-1089396811 None] Update group completed successfully.
Sep 25 15:06:56 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:06:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Flow 'volume_create_manager' (cbe008fa-1235-446e-80f4-70ea82753572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:06:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6f2a64-556a-4b59-8f93-abbca5164c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6f2a64-556a-4b59-8f93-abbca5164c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1004391716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc28552d43242ebad366ef5de94fe44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:06:56Z,use_quota=True,user_id='71d93bb03174417fbc01c27325f2abda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775568f3-94a7-4c98-8ad7-96bbffbf02ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775568f3-94a7-4c98-8ad7-96bbffbf02ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90baf709-6d2d-4312-a9f2-d7416a512fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:56 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 15:06:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b0e399fb-1728-49a9-9521-bcdc4d65e2ac tempest-GroupSnapshotsTest-1089396811 None] Update group completed successfully.
Sep 25 15:06:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90baf709-6d2d-4312-a9f2-d7416a512fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59', 'volume_name': 'volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59', 'volume_size': 1, 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd97dcba93bf843d9acf4a870a4730210', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'created_at': datetime.datetime(2026, 9, 25, 12, 52, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 52, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a354fa4c-98b3-48a7-8483-e976ebf152bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76381b923140>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcbce3cd-3e33-4bdf-9943-42d8bd4da02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcbce3cd-3e33-4bdf-9943-42d8bd4da02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:06:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12117e88-5c59-4ed6-bf34-1121d6c34e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:06:57 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Volume 2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59', 'volume_size': 1, 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd97dcba93bf843d9acf4a870a4730210', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'created_at': datetime.datetime(2026, 9, 25, 12, 52, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 52, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a354fa4c-98b3-48a7-8483-e976ebf152bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76381b923140>}
Sep 25 15:06:57 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Trying to clone 2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 from image a354fa4c-98b3-48a7-8483-e976ebf152bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 15:06:57 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_708lp873devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 15:06:57 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 15:06:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8eec6e84-eb20-432b-b655-fb8c6ed55cb5 tempest-GroupSnapshotsTest-1089396811 None] Update group completed successfully.
Sep 25 15:06:57 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4043dd1-0baf-404f-9f88-9c0b4e46315b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:06:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_708lp873devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:58 devstack sudo[97325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_708lp873devstack@QuobyteHD
Sep 25 15:06:58 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:58 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_708lp873devstack@QuobyteHD" returned: 0 in 0.851s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:58 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Temporary image a354fa4c-98b3-48a7-8483-e976ebf152bc is fetched for user 71d93bb03174417fbc01c27325f2abda. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 15:06:58 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[298336a8-34b1-4225-b5ce-2c208a7dcd2b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:06:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_708lp873devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:59 devstack sudo[97330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_708lp873devstack@QuobyteHD
Sep 25 15:06:59 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:06:59 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root
Sep 25 15:06:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_708lp873devstack@QuobyteHD" returned: 0 in 0.687s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:06:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1004391716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc28552d43242ebad366ef5de94fe44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:06:56Z,use_quota=True,user_id='71d93bb03174417fbc01c27325f2abda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:06:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Creating volume 2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:06:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:06:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:06:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:06:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:06:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:06:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:06:59 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:06:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:06:59 devstack sudo[97335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 1073741824
Sep 25 15:06:59 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] GroupSnapshot c05e3c85-f16a-466e-9325-46b9b04db104: creating.
Sep 25 15:07:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Group snapshot c05e3c85-f16a-466e-9325-46b9b04db104: creating. {{(pid=87071) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 25 15:07:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:00 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 1073741824" returned: 0 in 1.212s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:01 devstack sudo[97342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59
Sep 25 15:07:01 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:01 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59" returned: 0 in 0.454s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:07:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.141s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Creating offline snapshot 6f5fd267-745e-4cd0-8147-cce922ea9e80 of volume 534c12bf-d23c-45ae-a820-a891ea83d794 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:07:01 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Attempting download of a354fa4c-98b3-48a7-8483-e976ebf152bc ((None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}])) to volume 2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 15:07:01 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16a8d55-004e-4dfd-8ae8-c89e7ac24990]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:01 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae82660-3f42-4e61-919d-dde28475a66f]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_qrnu6yp1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:01 devstack sudo[97345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794
Sep 25 15:07:01 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:01 devstack sudo[97346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_qrnu6yp1
Sep 25 15:07:01 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:02 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794" returned: 0 in 0.929s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:02 devstack sudo[97380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80 1G
Sep 25 15:07:02 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:02 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_qrnu6yp1" returned: 0 in 0.930s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_qrnu6yp1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:02 devstack sudo[97422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_qrnu6yp1
Sep 25 15:07:02 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:03 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80 1G" returned: 0 in 1.007s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-534c12bf-d23c-45ae-a820-a891ea83d794 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:03 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_qrnu6yp1" returned: 1 in 0.911s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_qrnu6yp1' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:07:03 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[507c65bb-3fc8-4709-a6c2-c450bd70a8c9]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:03 devstack sudo[97448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-534c12bf-d23c-45ae-a820-a891ea83d794 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80
Sep 25 15:07:03 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_708lp873devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:03 devstack sudo[97452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_708lp873devstack@QuobyteHD
Sep 25 15:07:03 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:03 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-534c12bf-d23c-45ae-a820-a891ea83d794 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80" returned: 0 in 0.387s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:03 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 15:07:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:03 devstack sudo[97465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80
Sep 25 15:07:03 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:04 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_708lp873devstack@QuobyteHD" returned: 0 in 0.539s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:04 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] a354fa4c-98b3-48a7-8483-e976ebf152bc was qcow2, converting to qcow2 {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 15:07:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_708lp873devstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:04 devstack sudo[97477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_708lp873devstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59
Sep 25 15:07:04 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:04 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80" returned: 0 in 0.496s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:04 devstack sudo[97492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.info
Sep 25 15:07:04 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:04 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.info" returned: 0 in 0.469s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:04 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 15:07:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:04 devstack sudo[97501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.info
Sep 25 15:07:04 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:05 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.info" returned: 0 in 0.462s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.979s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Creating offline snapshot fdc1e4ed-73ac-4860-9b03-91b6267a41f0 of volume 9549aa47-49bc-4e0d-b9d9-0c400c90d53b {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:07:05 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd59829-21c1-4df3-b8de-a3b16526d4d0]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:05 devstack sudo[97506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b
Sep 25 15:07:05 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:06 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b" returned: 0 in 0.829s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:06 devstack sudo[97512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0 1G
Sep 25 15:07:06 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:07 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0 1G" returned: 0 in 0.932s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:07 devstack sudo[97519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0
Sep 25 15:07:07 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:07 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_708lp873devstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59" returned: 0 in 3.548s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:07 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_708lp873devstack@QuobyteHD, size 112.00 MB, duration 3.55 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:07:07 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Converted 112.00 MB image at 31.54 MB/s
Sep 25 15:07:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:07 devstack sudo[97521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 1G
Sep 25 15:07:07 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:07 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0" returned: 0 in 0.594s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:07 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 15:07:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:07 devstack sudo[97526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0
Sep 25 15:07:07 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:08 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 1G" returned: 0 in 0.737s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:08 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Downloaded image a354fa4c-98b3-48a7-8483-e976ebf152bc ((None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}])) to volume 2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 15:07:08 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Temporary image a354fa4c-98b3-48a7-8483-e976ebf152bc for user 71d93bb03174417fbc01c27325f2abda is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 15:07:08 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Marking volume 2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 15:07:08 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Copying metadata from image a354fa4c-98b3-48a7-8483-e976ebf152bc to 2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 15:07:08 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Creating volume glance metadata for volume 2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 backed by image a354fa4c-98b3-48a7-8483-e976ebf152bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 15:07:08 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0" returned: 0 in 0.459s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:08 devstack sudo[97533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.info
Sep 25 15:07:08 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12117e88-5c59-4ed6-bf34-1121d6c34e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59', 'volume_size': 1, 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd97dcba93bf843d9acf4a870a4730210', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'created_at': datetime.datetime(2026, 9, 25, 12, 52, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 52, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a354fa4c-98b3-48a7-8483-e976ebf152bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76381b923140>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3184ca6-b08a-4a48-9568-8f9a2e088f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:08 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Volume volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 (2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59): created successfully
Sep 25 15:07:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3184ca6-b08a-4a48-9568-8f9a2e088f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Flow 'volume_create_manager' (cbe008fa-1235-446e-80f4-70ea82753572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-781c448a-4675-42b1-adfc-f6bf8bc6c2c8 tempest-VolumesExtendTest-422660971 None] Created volume successfully.
Sep 25 15:07:08 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.info" returned: 0 in 0.422s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:08 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 15:07:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:08 devstack sudo[97550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.info
Sep 25 15:07:08 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:09 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.info" returned: 0 in 0.455s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.894s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:09 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-897111e8-851b-4109-b5a8-7796ac173533 tempest-GroupSnapshotsTest-1089396811 None] group_snapshot c05e3c85-f16a-466e-9325-46b9b04db104: created successfully
Sep 25 15:07:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-185f2d7d-39c9-4382-bb31-1c71879e2992 tempest-VolumesExtendTest-422660971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-185f2d7d-39c9-4382-bb31-1c71879e2992 tempest-VolumesExtendTest-422660971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:10 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f54211a-b448-4074-bcc6-2eae61bdbb93]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-185f2d7d-39c9-4382-bb31-1c71879e2992 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:10 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] group_snapshot c05e3c85-f16a-466e-9325-46b9b04db104: deleting
Sep 25 15:07:10 devstack sudo[97568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59
Sep 25 15:07:10 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] group_snapshot c05e3c85-f16a-466e-9325-46b9b04db104: deleting {{(pid=87071) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 25 15:07:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "cinder-quobyte-534c12bf-d23c-45ae-a820-a891ea83d794" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-534c12bf-d23c-45ae-a820-a891ea83d794" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "cinder-quobyte-6f5fd267-745e-4cd0-8147-cce922ea9e80" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-6f5fd267-745e-4cd0-8147-cce922ea9e80" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Deleting offline snapshot 6f5fd267-745e-4cd0-8147-cce922ea9e80 of volume 534c12bf-d23c-45ae-a820-a891ea83d794 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:07:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] snapshot_file for this snap is: volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:07:10 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b323f0c4-cfcd-449f-8abb-38ba6c0c74b5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:10 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-185f2d7d-39c9-4382-bb31-1c71879e2992 tempest-VolumesExtendTest-422660971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59" returned: 0 in 0.715s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:10 devstack sudo[97571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80
Sep 25 15:07:10 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-185f2d7d-39c9-4382-bb31-1c71879e2992 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 2G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-185f2d7d-39c9-4382-bb31-1c71879e2992 tempest-VolumesExtendTest-422660971 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 2G" returned: 0 in 0.217s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-185f2d7d-39c9-4382-bb31-1c71879e2992 tempest-VolumesExtendTest-422660971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.978s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-185f2d7d-39c9-4382-bb31-1c71879e2992 tempest-VolumesExtendTest-422660971 None] Extend volume completed successfully.
Sep 25 15:07:11 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80" returned: 0 in 0.696s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-534c12bf-d23c-45ae-a820-a891ea83d794(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:07:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f460a7-4f8c-498a-80f4-205dcd003e9c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:11 devstack sudo[97583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794
Sep 25 15:07:11 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Acquiring lock "cinder-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Lock "cinder-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Acquiring lock "cinder-quobyte-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Lock "cinder-quobyte-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:12 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[658d0fc3-5f13-47ae-9e37-40b4570fd720]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:12 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794" returned: 0 in 0.880s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:12 devstack sudo[97596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80
Sep 25 15:07:12 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:12 devstack sudo[97595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59
Sep 25 15:07:12 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:13 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:13 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59" returned: 0 in 0.732s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:13 devstack sudo[97615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80" returned: 0 in 0.752s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:13 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:13 devstack sudo[97617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80
Sep 25 15:07:13 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:13 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59" returned: 0 in 0.551s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Lock "cinder-quobyte-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59" released by "delete_volume" :: held 1.367s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:13 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794.6f5fd267-745e-4cd0-8147-cce922ea9e80" returned: 0 in 0.633s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-6f5fd267-745e-4cd0-8147-cce922ea9e80" released by "_delete_snapshot" :: held 3.203s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Created reservations ['99e793d6-a8ab-4fcb-a078-c59f1b840c6d', 'd92eaab0-cb08-42df-9197-122ddb2e902b', '22ae5373-d442-407e-a566-6e941051657c', 'be8abe1a-6cce-44c4-b0f3-eeea9c0f54fd'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-534c12bf-d23c-45ae-a820-a891ea83d794" released by "delete_snapshot" :: held 3.255s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "cinder-quobyte-9549aa47-49bc-4e0d-b9d9-0c400c90d53b" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-9549aa47-49bc-4e0d-b9d9-0c400c90d53b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "cinder-quobyte-fdc1e4ed-73ac-4860-9b03-91b6267a41f0" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-fdc1e4ed-73ac-4860-9b03-91b6267a41f0" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Deleting offline snapshot fdc1e4ed-73ac-4860-9b03-91b6267a41f0 of volume 9549aa47-49bc-4e0d-b9d9-0c400c90d53b {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] snapshot_file for this snap is: volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabfddec-d6cd-4427-b72f-1adc23752978]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:14 devstack sudo[97622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:07:14 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:14 devstack sudo[97621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0
Sep 25 15:07:14 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Flow 'volume_create_manager' (b3ab1373-628d-4898-8977-be2eafad6096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf9c92f-89b1-40ab-b576-e8c4ebe75ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf9c92f-89b1-40ab-b576-e8c4ebe75ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-917242844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371bfb5f36734c489c4bc1dac851df0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:14Z,use_quota=True,user_id='04a15b6a35e54761bda03819df5208ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ce869d-848a-4281-aed7-ca28144802f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ce869d-848a-4281-aed7-ca28144802f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3e9d02-3ba6-48cc-bf47-47722aedc488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3e9d02-3ba6-48cc-bf47-47722aedc488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c', 'volume_name': 'volume-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2601e9-eab4-4267-9e45-cfa3f6bc50d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:14 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2601e9-eab4-4267-9e45-cfa3f6bc50d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48472c20-1de8-4790-8d9e-2422d3698fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:14 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Volume 18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c', 'volume_size': 1}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-917242844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371bfb5f36734c489c4bc1dac851df0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:14Z,use_quota=True,user_id='04a15b6a35e54761bda03819df5208ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Creating volume 18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:07:14 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.346s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:07:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Deleted volume successfully.
Sep 25 15:07:14 devstack sudo[97626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c 1073741824
Sep 25 15:07:14 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-06021b83-a7d4-49c6-b919-a7754b68faec tempest-VolumesExtendTest-422660971 None] Lock "cinder-2a4c9ba9-7160-472a-bc62-d0fd8e8d8a59-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:14 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0" returned: 0 in 0.491s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65be78f-9aa3-4099-9224-4436cbde6d54]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:14 devstack sudo[97631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b
Sep 25 15:07:14 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:14 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c 1073741824" returned: 0 in 0.621s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:15 devstack sudo[97640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c
Sep 25 15:07:15 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:15 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b" returned: 0 in 0.593s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:15 devstack sudo[97643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0
Sep 25 15:07:15 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Flow 'volume_create_manager' (db6a94df-d7cb-4875-9d18-5c797aeab283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afed015-c2a3-443b-aec2-fa38806cbebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afed015-c2a3-443b-aec2-fa38806cbebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2059947951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25be37d8-78e8-4302-bfc8-b3a2aa760458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc28552d43242ebad366ef5de94fe44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:15Z,use_quota=True,user_id='71d93bb03174417fbc01c27325f2abda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5efd1fa-89a0-44b7-b583-8db6afd75276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5efd1fa-89a0-44b7-b583-8db6afd75276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:15 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0780108-93d9-409a-810b-3b2dd32c6658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0780108-93d9-409a-810b-3b2dd32c6658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25be37d8-78e8-4302-bfc8-b3a2aa760458', 'volume_name': 'volume-25be37d8-78e8-4302-bfc8-b3a2aa760458', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (debedaf6-0768-405c-a709-9195cb2aa73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (debedaf6-0768-405c-a709-9195cb2aa73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e632ae3d-385c-4076-b973-261e25cc7f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Volume 25be37d8-78e8-4302-bfc8-b3a2aa760458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25be37d8-78e8-4302-bfc8-b3a2aa760458', 'volume_size': 1}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c" returned: 0 in 0.366s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2059947951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25be37d8-78e8-4302-bfc8-b3a2aa760458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc28552d43242ebad366ef5de94fe44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:15Z,use_quota=True,user_id='71d93bb03174417fbc01c27325f2abda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Creating volume 25be37d8-78e8-4302-bfc8-b3a2aa760458 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:07:15 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48472c20-1de8-4790-8d9e-2422d3698fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:15 devstack sudo[97648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458 1073741824
Sep 25 15:07:15 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d570559-a1c5-49dd-95fd-f8c29aeaaf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Volume volume-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c (18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c): created successfully
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d570559-a1c5-49dd-95fd-f8c29aeaaf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Flow 'volume_create_manager' (b3ab1373-628d-4898-8977-be2eafad6096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b9501cf6-d72f-4e9e-944a-9a695b9c767e tempest-ServersNegativeTestJSON-1145485831 None] Created volume successfully.
Sep 25 15:07:15 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0" returned: 0 in 0.482s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:15 devstack sudo[97651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0
Sep 25 15:07:15 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:15 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b.fdc1e4ed-73ac-4860-9b03-91b6267a41f0" returned: 0 in 0.297s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-fdc1e4ed-73ac-4860-9b03-91b6267a41f0" released by "_delete_snapshot" :: held 2.031s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-9549aa47-49bc-4e0d-b9d9-0c400c90d53b" released by "delete_snapshot" :: held 2.072s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:15 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458 1073741824" returned: 0 in 0.570s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:16 devstack sudo[97662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458
Sep 25 15:07:16 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:16 devstack cinder-volume[87071]: WARNING cinder.quota [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-218527738 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-218527738, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:07:16 devstack cinder-volume[87071]: WARNING cinder.quota [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-218527738 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-218527738, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:07:16 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Created reservations ['bd750daa-5860-4ca2-b229-45f170b81486', 'b04b6cfa-cc4d-48b1-b2c3-91302cf4c5aa', 'cf7fa85f-5ad9-4e96-a47e-18b2cceb07b3', '001eaca0-2eec-4eb9-8aa6-bbbe6f449ce2'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:16 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] Created reservations ['ae17e7f8-d378-4a72-a2a0-7d12aa62519e', '36a9bc03-a094-403f-9ee8-7f6f2d79b856', '2a99089b-b530-4cfb-9a22-29b5a895f4e2', 'cf0686ea-45db-44c0-9ae2-0299bd8bebe4'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:16 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458" returned: 0 in 0.559s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:07:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1ef320a5-20af-4064-903e-9d1f50e5057e tempest-GroupSnapshotsTest-1089396811 None] group_snapshot c05e3c85-f16a-466e-9325-46b9b04db104: deleted successfully
Sep 25 15:07:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e632ae3d-385c-4076-b973-261e25cc7f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25be37d8-78e8-4302-bfc8-b3a2aa760458', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc150b67-aeb0-41ec-be1d-f2f758c4c6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Volume volume-25be37d8-78e8-4302-bfc8-b3a2aa760458 (25be37d8-78e8-4302-bfc8-b3a2aa760458): created successfully
Sep 25 15:07:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc150b67-aeb0-41ec-be1d-f2f758c4c6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Flow 'volume_create_manager' (db6a94df-d7cb-4875-9d18-5c797aeab283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3c4a4937-0fca-4bdd-aa9f-6358d05c0fc4 tempest-VolumesExtendTest-422660971 None] Created volume successfully.
Sep 25 15:07:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] Creating offline snapshot 73e9ca15-e37a-43d5-a540-4009a182d3c5 of volume 25be37d8-78e8-4302-bfc8-b3a2aa760458 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:07:17 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[332cb6d4-a58b-474a-a0f4-2b1cc2ac706e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:17 devstack sudo[97696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458
Sep 25 15:07:17 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Flow 'volume_create_manager' (98efbe2a-0745-4962-8be6-001d75d9172c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d31759-a4a4-44aa-8b2c-0bfe346e4a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d31759-a4a4-44aa-8b2c-0bfe346e4a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1582913708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371bfb5f36734c489c4bc1dac851df0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:18Z,use_quota=True,user_id='04a15b6a35e54761bda03819df5208ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2796a79-7e45-4d50-9404-25c5951325ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2796a79-7e45-4d50-9404-25c5951325ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def1ada0-7236-4fe1-a244-16376a2466c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def1ada0-7236-4fe1-a244-16376a2466c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb', 'volume_name': 'volume-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6297b49-a5dc-4ba7-b61b-7d16e73d3872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6297b49-a5dc-4ba7-b61b-7d16e73d3872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d354f8-7b7e-4cfd-a2c8-5da90c559915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:18 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Volume 8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb', 'volume_size': 1}
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:18 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458" returned: 0 in 0.601s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:18 devstack sudo[97712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5 1G
Sep 25 15:07:18 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "cinder-quobyte-534c12bf-d23c-45ae-a820-a891ea83d794" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-534c12bf-d23c-45ae-a820-a891ea83d794" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd98ccd9-3711-49a5-8dbf-f86e0905c762]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:18 devstack sudo[97714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794
Sep 25 15:07:18 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:18 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5 1G" returned: 0 in 0.592s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25be37d8-78e8-4302-bfc8-b3a2aa760458 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:18 devstack sudo[97721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25be37d8-78e8-4302-bfc8-b3a2aa760458 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5
Sep 25 15:07:18 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:19 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794" returned: 0 in 0.450s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:19 devstack sudo[97724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794
Sep 25 15:07:19 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:19 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-534c12bf-d23c-45ae-a820-a891ea83d794" returned: 0 in 0.337s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-534c12bf-d23c-45ae-a820-a891ea83d794" released by "delete_volume" :: held 0.927s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "cinder-quobyte-9549aa47-49bc-4e0d-b9d9-0c400c90d53b" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-9549aa47-49bc-4e0d-b9d9-0c400c90d53b" acquired by "delete_volume" :: waited 0.042s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:19 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25be37d8-78e8-4302-bfc8-b3a2aa760458 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5" returned: 0 in 0.526s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:19 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5 is being set with open permissions: ugo+rw
Sep 25 15:07:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad0d8c6-c4d1-4393-89f2-bf9b1d2b4052]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:19 devstack sudo[97732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5
Sep 25 15:07:19 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:19 devstack sudo[97733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b
Sep 25 15:07:19 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:19 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5" returned: 0 in 0.344s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:19 devstack sudo[97737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.info
Sep 25 15:07:19 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:19 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b" returned: 0 in 0.467s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:20 devstack sudo[97742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b
Sep 25 15:07:20 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:20 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.info" returned: 0 in 0.384s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:20 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:20 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.info is being set with open permissions: ugo+rw
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9549aa47-49bc-4e0d-b9d9-0c400c90d53b" returned: 0 in 0.291s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:20 devstack sudo[97746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.info
Sep 25 15:07:20 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-9549aa47-49bc-4e0d-b9d9-0c400c90d53b" released by "delete_volume" :: held 0.859s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Created reservations ['4977481b-3823-4f9e-9e8a-98bccafbc788'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:20 devstack cinder-volume[87071]: WARNING cinder.quota [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-218527738 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-218527738, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Created reservations ['29a36a64-8458-496a-bfc9-d4e7375781f8', '455a86c9-706d-48e6-aaa5-5da9e1b23e4a', '8c1e3cc3-61a3-49a1-9239-46383b2ceb94', 'cf659431-6adc-4f50-b043-5f178eb4fc19'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:20 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.info" returned: 0 in 0.339s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.935s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.293s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1582913708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371bfb5f36734c489c4bc1dac851df0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:18Z,use_quota=True,user_id='04a15b6a35e54761bda03819df5208ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Creating volume 8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:07:20 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:20 devstack sudo[97749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb 1073741824
Sep 25 15:07:20 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:20 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-805c822d-268c-4d1d-81ee-b7454ad69958 tempest-VolumesExtendTest-422660971 None] Create snapshot completed successfully
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Created reservations ['0dc1182c-9f13-4cb3-8be6-f5e72187260a', '5dc08f71-0a4a-41fb-98f6-3d9786e5c852', '560cd878-8a48-4f86-b83f-843f5814a5a5', '252ce913-6704-4afd-8301-32db2c3974d9'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:20 devstack sudo[97751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:07:20 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:21 devstack sudo[97753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:07:21 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a712cb03-98de-4e4a-b32a-a80709da03a6 tempest-VolumesExtendTest-422660971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:21 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.619s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:07:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:07:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:07:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:07:21 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.562s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:07:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-516292f5-9d6c-47ba-b405-746313f5e08b tempest-GroupSnapshotsTest-1089396811 None] Delete group completed successfully.
Sep 25 15:07:21 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb 1073741824" returned: 0 in 1.073s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:21 devstack sudo[97760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb
Sep 25 15:07:21 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3ee658c0-5efa-444e-bf71-fd5356011dfa tempest-GroupSnapshotsTest-1089396811 None] Group tempest-GroupSnapshotsTest-Group-936482666: creating
Sep 25 15:07:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3ee658c0-5efa-444e-bf71-fd5356011dfa tempest-GroupSnapshotsTest-1089396811 None] Group tempest-GroupSnapshotsTest-Group-936482666: created successfully
Sep 25 15:07:22 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3ee658c0-5efa-444e-bf71-fd5356011dfa tempest-GroupSnapshotsTest-1089396811 None] Create group completed successfully.
Sep 25 15:07:22 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb" returned: 0 in 0.354s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:07:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a712cb03-98de-4e4a-b32a-a80709da03a6 tempest-VolumesExtendTest-422660971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.763s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d354f8-7b7e-4cfd-a2c8-5da90c559915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe595875-cd30-4172-9d4a-16f29965daf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:22 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7565a527-5599-4abf-8dac-6e0677b1b997]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a712cb03-98de-4e4a-b32a-a80709da03a6 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:22 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Volume volume-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb (8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb): created successfully
Sep 25 15:07:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe595875-cd30-4172-9d4a-16f29965daf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Flow 'volume_create_manager' (98efbe2a-0745-4962-8be6-001d75d9172c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:22 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e241678f-7037-420a-8237-3d8608aa95aa tempest-ServersNegativeTestJSON-1145485831 None] Created volume successfully.
Sep 25 15:07:22 devstack sudo[97763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458
Sep 25 15:07:22 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:22 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a712cb03-98de-4e4a-b32a-a80709da03a6 tempest-VolumesExtendTest-422660971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458" returned: 0 in 0.565s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a712cb03-98de-4e4a-b32a-a80709da03a6 tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5 2G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a712cb03-98de-4e4a-b32a-a80709da03a6 tempest-VolumesExtendTest-422660971 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5 2G" returned: 0 in 0.284s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a712cb03-98de-4e4a-b32a-a80709da03a6 tempest-VolumesExtendTest-422660971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.906s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Acquiring lock "cinder-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a712cb03-98de-4e4a-b32a-a80709da03a6 tempest-VolumesExtendTest-422660971 None] Extend volume completed successfully.
Sep 25 15:07:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Lock "cinder-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Acquiring lock "cinder-quobyte-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Lock "cinder-quobyte-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:23 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58ee371-e75a-4667-bcd3-5d773585bd73]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:23 devstack sudo[97772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb
Sep 25 15:07:23 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:24 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb" returned: 0 in 0.735s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Acquiring lock "cinder-73e9ca15-e37a-43d5-a540-4009a182d3c5-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:24 devstack sudo[97778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Lock "cinder-73e9ca15-e37a-43d5-a540-4009a182d3c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Acquiring lock "cinder-quobyte-25be37d8-78e8-4302-bfc8-b3a2aa760458" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:24 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Flow 'volume_create_manager' (98bfb363-ce97-4d4a-b18e-12d6bcbbfd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a05d5e-590a-4c6a-89e9-d6ad26799bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Lock "cinder-quobyte-25be37d8-78e8-4302-bfc8-b3a2aa760458" acquired by "delete_snapshot" :: waited 0.081s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Acquiring lock "cinder-quobyte-73e9ca15-e37a-43d5-a540-4009a182d3c5" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a05d5e-590a-4c6a-89e9-d6ad26799bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-169565601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9c6f15f6-241d-4596-b9f0-2a793127a861,host='devstack@QuobyteHD#QuobyteHD',id=5a8e6d40-0fc5-4772-a8b4-f2212341bf98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73b76d1f9da4f9196f86496c58aa584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:24Z,use_quota=True,user_id='da74994d182d480a90f0f6a230f44dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8df6f891-174a-4b2c-955c-c88d457d56e4),volume_type_id=8df6f891-174a-4b2c-955c-c88d457d56e4)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc767175-d11f-4ebd-97df-0f46c8ebfb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc767175-d11f-4ebd-97df-0f46c8ebfb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b2801c-6a2a-4056-90cd-3d59add70eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b2801c-6a2a-4056-90cd-3d59add70eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a8e6d40-0fc5-4772-a8b4-f2212341bf98', 'volume_name': 'volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7caafb5d-594b-4119-a066-ba1667bd301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7caafb5d-594b-4119-a066-ba1667bd301e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6a46db-9d33-47d4-89f6-f155841fe08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:24 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Volume 5a8e6d40-0fc5-4772-a8b4-f2212341bf98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98', 'volume_size': 1}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9c6f15f6-241d-4596-b9f0-2a793127a861,created_at=2026-09-25T13:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-169565601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9c6f15f6-241d-4596-b9f0-2a793127a861,host='devstack@QuobyteHD#QuobyteHD',id=5a8e6d40-0fc5-4772-a8b4-f2212341bf98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73b76d1f9da4f9196f86496c58aa584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:24Z,use_quota=True,user_id='da74994d182d480a90f0f6a230f44dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8df6f891-174a-4b2c-955c-c88d457d56e4),volume_type_id=8df6f891-174a-4b2c-955c-c88d457d56e4)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Creating volume 5a8e6d40-0fc5-4772-a8b4-f2212341bf98 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:07:24 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Lock "cinder-quobyte-73e9ca15-e37a-43d5-a540-4009a182d3c5" acquired by "_delete_snapshot" :: waited 0.107s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Deleting offline snapshot 73e9ca15-e37a-43d5-a540-4009a182d3c5 of volume 25be37d8-78e8-4302-bfc8-b3a2aa760458 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] snapshot_file for this snap is: volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:07:24 devstack sudo[97780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98 1073741824
Sep 25 15:07:24 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[187a560a-f4a1-41b6-81c0-3beb72b5b2d1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:24 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb" returned: 0 in 0.427s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Lock "cinder-quobyte-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb" released by "delete_volume" :: held 1.223s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:24 devstack sudo[97782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5
Sep 25 15:07:24 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Created reservations ['b3ed84a5-0db2-40bc-8d00-489ed1d16eb0', '88c43750-f8b8-4bde-b93e-82f33e29555b', '0a76a15d-735d-4ab8-8ebc-604f671eafd6', '8b1effb4-d809-40ad-90fa-b6dced82a13e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:24 devstack sudo[97787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:07:24 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:24 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5" returned: 0 in 0.608s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25be37d8-78e8-4302-bfc8-b3a2aa760458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:07:24 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98 1073741824" returned: 0 in 0.723s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[df127a93-9729-4cf3-87e4-70ae28ab2e26]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:25 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.404s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:07:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Deleted volume successfully.
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:25 devstack sudo[97796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98
Sep 25 15:07:25 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-457a5a19-ba2f-42bf-8364-1e754e53ecc7 tempest-ServersNegativeTestJSON-1145485831 None] Lock "cinder-8ba770ed-1aa5-4caf-b7a8-1f5c0360dacb-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:25 devstack sudo[97795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458
Sep 25 15:07:25 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:25 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:25 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Acquiring lock "cinder-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98" returned: 0 in 0.456s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458" returned: 0 in 0.525s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6a46db-9d33-47d4-89f6-f155841fe08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:25 devstack sudo[97803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5
Sep 25 15:07:25 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af37c9dc-9fbe-42b2-a49c-d7149da9ba61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Lock "cinder-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:25 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Volume volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98 (5a8e6d40-0fc5-4772-a8b4-f2212341bf98): created successfully
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af37c9dc-9fbe-42b2-a49c-d7149da9ba61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Flow 'volume_create_manager' (98bfb363-ce97-4d4a-b18e-12d6bcbbfd44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Acquiring lock "cinder-quobyte-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8296d796-c006-4f74-be34-79ce3d44efe9 tempest-GroupSnapshotsTest-1089396811 None] Created volume successfully.
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Lock "cinder-quobyte-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c" acquired by "delete_volume" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9ce21a-8f36-4bad-80d0-682bc2722292]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:25 devstack sudo[97805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c
Sep 25 15:07:25 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:26 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5" returned: 0 in 0.581s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:26 devstack sudo[97810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5
Sep 25 15:07:26 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:26 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c" returned: 0 in 0.596s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:26 devstack sudo[97815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c
Sep 25 15:07:26 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:26 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458.73e9ca15-e37a-43d5-a540-4009a182d3c5" returned: 0 in 0.423s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Lock "cinder-quobyte-73e9ca15-e37a-43d5-a540-4009a182d3c5" released by "_delete_snapshot" :: held 2.325s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Lock "cinder-quobyte-25be37d8-78e8-4302-bfc8-b3a2aa760458" released by "delete_snapshot" :: held 2.445s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Created reservations ['0b062abb-c83c-429b-b9ea-aaafac654c7a', '0af79071-1f82-4d6c-b363-d3591b6fdbc6', '8a1f2f35-9651-4fe5-9f23-cf6f31c0ce70', '5aa1081e-7e35-4352-a0eb-fd67e1e88cec'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:26 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c" returned: 0 in 0.412s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Lock "cinder-quobyte-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c" released by "delete_volume" :: held 1.067s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Delete snapshot completed successfully.
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e183218a-f732-4a7a-b36e-7aa12a9e90ad tempest-VolumesExtendTest-422660971 None] Lock "cinder-73e9ca15-e37a-43d5-a540-4009a182d3c5-delete_snapshot" released by "delete_snapshot" :: held 2.761s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Created reservations ['54523fdd-d616-439a-9839-7bbef373fa2f', '30b26857-305d-4555-b35d-ed91545bacaa', '389dd6e3-6967-4ed2-8081-deedd5217598', 'bd124fc6-4db3-4c3e-a8dc-40bb35f0cb66'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:26 devstack sudo[97819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:07:26 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] GroupSnapshot 7593ed11-a9cc-443a-93b4-7d84720b4a2b: creating.
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] Group snapshot 7593ed11-a9cc-443a-93b4-7d84720b4a2b: creating. {{(pid=87071) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] Creating offline snapshot c441e62b-5c3e-4418-a51d-d424bb9cee2f of volume 5a8e6d40-0fc5-4772-a8b4-f2212341bf98 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33d2294-cee4-4673-a05a-8a68db6a07a9]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:27 devstack sudo[97821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98
Sep 25 15:07:27 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:27 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.275s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:07:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Deleted volume successfully.
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=143,cinder:INSERT=36,cinder:SELECT=124,cinder:DELETE=7 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-82f85ff2-da4b-4f26-933c-273ff4933960 tempest-ServersNegativeTestJSON-1145485831 None] Lock "cinder-18a46a38-cf6e-4abc-8b7f-a1189fa9fa5c-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Acquiring lock "cinder-25be37d8-78e8-4302-bfc8-b3a2aa760458-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Lock "cinder-25be37d8-78e8-4302-bfc8-b3a2aa760458-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=137,cinder:UPDATE=124,cinder:INSERT=36,cinder:DELETE=5 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Acquiring lock "cinder-quobyte-25be37d8-78e8-4302-bfc8-b3a2aa760458" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Lock "cinder-quobyte-25be37d8-78e8-4302-bfc8-b3a2aa760458" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:27 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98" returned: 0 in 0.510s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d50f2b-7a19-456f-bbf5-72f470f7f8ee]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:27 devstack sudo[97828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f 1G
Sep 25 15:07:27 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:27 devstack sudo[97829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458
Sep 25 15:07:27 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:28 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458" returned: 0 in 0.563s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:28 devstack sudo[97838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458
Sep 25 15:07:28 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:28 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f 1G" returned: 0 in 0.720s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:28 devstack sudo[97841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f
Sep 25 15:07:28 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:28 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-25be37d8-78e8-4302-bfc8-b3a2aa760458" returned: 0 in 0.485s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Lock "cinder-quobyte-25be37d8-78e8-4302-bfc8-b3a2aa760458" released by "delete_volume" :: held 1.149s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:28 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Created reservations ['177df847-46e9-4cc8-be1d-6e8f419e0259', '5f8b7af4-3a0e-474f-9197-24a18ad3ddd5', '4a5b0d79-e5dc-4bcc-9b05-ed15a40c27d4', 'e310fae5-0e55-4ecd-8d60-e1466179a02c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:28 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f" returned: 0 in 0.562s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:28 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 15:07:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:28 devstack sudo[97855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f
Sep 25 15:07:28 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:29 devstack sudo[97862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:07:29 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:29 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f" returned: 0 in 0.655s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:29 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.657s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:29 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:07:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Deleted volume successfully.
Sep 25 15:07:29 devstack sudo[97877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.info
Sep 25 15:07:29 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5850aa34-3d38-47f7-9db0-0d195b5e4cce tempest-VolumesExtendTest-422660971 None] Lock "cinder-25be37d8-78e8-4302-bfc8-b3a2aa760458-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:30 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.info" returned: 0 in 0.666s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:30 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 15:07:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:30 devstack sudo[97880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.info
Sep 25 15:07:30 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:30 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.info" returned: 0 in 0.349s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.623s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a5160ad1-3ed8-4a39-9f7f-9f73e29f623d tempest-GroupSnapshotsTest-1089396811 None] group_snapshot 7593ed11-a9cc-443a-93b4-7d84720b4a2b: created successfully
Sep 25 15:07:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] group_snapshot 7593ed11-a9cc-443a-93b4-7d84720b4a2b: deleting
Sep 25 15:07:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] group_snapshot 7593ed11-a9cc-443a-93b4-7d84720b4a2b: deleting {{(pid=87071) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 25 15:07:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "cinder-quobyte-5a8e6d40-0fc5-4772-a8b4-f2212341bf98" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-5a8e6d40-0fc5-4772-a8b4-f2212341bf98" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "cinder-quobyte-c441e62b-5c3e-4418-a51d-d424bb9cee2f" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-c441e62b-5c3e-4418-a51d-d424bb9cee2f" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] Deleting offline snapshot c441e62b-5c3e-4418-a51d-d424bb9cee2f of volume 5a8e6d40-0fc5-4772-a8b4-f2212341bf98 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:07:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] snapshot_file for this snap is: volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:07:32 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8370b177-c207-4248-a0aa-c5a27dbf7f0c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:32 devstack sudo[97885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f
Sep 25 15:07:32 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:32 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f" returned: 0 in 0.549s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:07:32 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d0ae5a-e197-4a3e-9425-321c3aa24f3b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:33 devstack sudo[97890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98
Sep 25 15:07:33 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:33 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98" returned: 0 in 0.565s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:33 devstack sudo[97895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f
Sep 25 15:07:33 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:34 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f" returned: 0 in 0.642s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:34 devstack sudo[97906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f
Sep 25 15:07:34 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:34 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98.c441e62b-5c3e-4418-a51d-d424bb9cee2f" returned: 0 in 0.553s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-c441e62b-5c3e-4418-a51d-d424bb9cee2f" released by "_delete_snapshot" :: held 2.537s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-5a8e6d40-0fc5-4772-a8b4-f2212341bf98" released by "delete_snapshot" :: held 2.600s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:34 devstack cinder-volume[87071]: WARNING cinder.quota [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-412338512 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-412338512, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:07:34 devstack cinder-volume[87071]: WARNING cinder.quota [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-412338512 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-412338512, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:07:34 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] Created reservations ['2bf3d0f4-e074-41a3-b8fd-3ad3bd8ba953', '32e9cd64-be0d-4505-b1e5-71d67fd7304a', '92d7c423-fd70-4083-a739-79976c8f6914', '7aa53ff8-a31d-44bf-990d-72f58e69bda7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5d3d8f37-1741-47d8-b49e-3f0f64e4674c tempest-GroupSnapshotsTest-1089396811 None] group_snapshot 7593ed11-a9cc-443a-93b4-7d84720b4a2b: deleted successfully
Sep 25 15:07:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "cinder-quobyte-5a8e6d40-0fc5-4772-a8b4-f2212341bf98" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-5a8e6d40-0fc5-4772-a8b4-f2212341bf98" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:36 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc666386-5acc-4f0f-bbcc-5bf697a905b0]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:36 devstack sudo[97911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98
Sep 25 15:07:36 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:36 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98" returned: 0 in 0.540s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:36 devstack sudo[97916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98
Sep 25 15:07:36 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:37 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a8e6d40-0fc5-4772-a8b4-f2212341bf98" returned: 0 in 0.390s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] Lock "cinder-quobyte-5a8e6d40-0fc5-4772-a8b4-f2212341bf98" released by "delete_volume" :: held 1.038s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:37 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] Created reservations ['b9bac50e-2fbc-4df3-89da-734496ff3de2'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:37 devstack cinder-volume[87071]: WARNING cinder.quota [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-412338512 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-412338512, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:07:37 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] Created reservations ['484be346-7ac0-483e-8b4a-4fb5635ed5bf', '23789af4-157f-47e5-aa63-c9e5e0f1ec58', '3c769e34-8bd3-4a92-8e7b-aca88b1a3f62', 'a3b024ba-f80d-4a76-ae3b-a9d96ef35faa'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:37 devstack sudo[97920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:07:37 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:37 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.337s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:37 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:07:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2262af5c-8869-4751-bdee-1d94f7c7f4a8 tempest-GroupSnapshotsTest-1089396811 None] Delete group completed successfully.
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Flow 'volume_create_manager' (531db76c-58ab-4e7f-bda1-3e8ad6ebeb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ce80f5-9fd8-45ea-bf47-2fb40623183c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ce80f5-9fd8-45ea-bf47-2fb40623183c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-998178825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5481e9d5-5027-4a60-a954-e99380938110,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a2dc3abe3946b08045300ea91a7eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:42Z,use_quota=True,user_id='14a330ddbe2948b2b49ea7d2d3f0588b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106cc752-095f-4e6e-8926-8dcf2b306cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106cc752-095f-4e6e-8926-8dcf2b306cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5f9d74-b7c4-48cf-810a-5aa075b13d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5f9d74-b7c4-48cf-810a-5aa075b13d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5481e9d5-5027-4a60-a954-e99380938110', 'volume_name': 'volume-5481e9d5-5027-4a60-a954-e99380938110', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca34844-0095-4330-ab54-c19f1679fb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca34844-0095-4330-ab54-c19f1679fb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013fdd0d-dd9c-4e0a-b96f-7cf8b3f28fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Volume 5481e9d5-5027-4a60-a954-e99380938110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5481e9d5-5027-4a60-a954-e99380938110', 'volume_size': 1}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-998178825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5481e9d5-5027-4a60-a954-e99380938110,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a2dc3abe3946b08045300ea91a7eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:42Z,use_quota=True,user_id='14a330ddbe2948b2b49ea7d2d3f0588b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Creating volume 5481e9d5-5027-4a60-a954-e99380938110 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:07:42 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:07:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5481e9d5-5027-4a60-a954-e99380938110 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:42 devstack sudo[97925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5481e9d5-5027-4a60-a954-e99380938110 1073741824
Sep 25 15:07:42 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:43 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5481e9d5-5027-4a60-a954-e99380938110 1073741824" returned: 0 in 0.740s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5481e9d5-5027-4a60-a954-e99380938110 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:43 devstack sudo[97931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5481e9d5-5027-4a60-a954-e99380938110
Sep 25 15:07:43 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:43 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5481e9d5-5027-4a60-a954-e99380938110" returned: 0 in 0.359s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:07:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013fdd0d-dd9c-4e0a-b96f-7cf8b3f28fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5481e9d5-5027-4a60-a954-e99380938110', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eddbb0c-bb14-4599-90ae-cc90b4d5825e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:43 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Volume volume-5481e9d5-5027-4a60-a954-e99380938110 (5481e9d5-5027-4a60-a954-e99380938110): created successfully
Sep 25 15:07:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eddbb0c-bb14-4599-90ae-cc90b4d5825e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Flow 'volume_create_manager' (531db76c-58ab-4e7f-bda1-3e8ad6ebeb07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:43 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d78f60b6-3306-444a-8c3f-cd54ce90f4c5 tempest-VolumesListTestJSON-1578338060 None] Created volume successfully.
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Flow 'volume_create_manager' (ff18890b-bb4a-4030-b8dd-dd3e53aac083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e86a9c-34d4-4260-9db4-6d0d3b9d9d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e86a9c-34d4-4260-9db4-6d0d3b9d9d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-170919315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73abf328-18a8-41a9-a10d-7d6567cd6283,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a2dc3abe3946b08045300ea91a7eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:45Z,use_quota=True,user_id='14a330ddbe2948b2b49ea7d2d3f0588b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b5d01a-8772-435d-9390-c016b428c5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b5d01a-8772-435d-9390-c016b428c5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd894be-e84e-4c3f-b16a-5887b94f8874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd894be-e84e-4c3f-b16a-5887b94f8874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73abf328-18a8-41a9-a10d-7d6567cd6283', 'volume_name': 'volume-73abf328-18a8-41a9-a10d-7d6567cd6283', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2332b50a-2ef9-4d7f-baf5-d11425b6f6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2332b50a-2ef9-4d7f-baf5-d11425b6f6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2040f34-d905-4458-aae3-b4fc7c79df85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Volume 73abf328-18a8-41a9-a10d-7d6567cd6283: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73abf328-18a8-41a9-a10d-7d6567cd6283', 'volume_size': 1}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-170919315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73abf328-18a8-41a9-a10d-7d6567cd6283,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a2dc3abe3946b08045300ea91a7eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:45Z,use_quota=True,user_id='14a330ddbe2948b2b49ea7d2d3f0588b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Creating volume 73abf328-18a8-41a9-a10d-7d6567cd6283 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:07:45 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73abf328-18a8-41a9-a10d-7d6567cd6283 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:45 devstack sudo[97934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73abf328-18a8-41a9-a10d-7d6567cd6283 1073741824
Sep 25 15:07:45 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Flow 'volume_create_manager' (c18151d8-d5a5-4b8c-a55d-4cf8aaf94d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3a1bce-6bd1-4d12-bf93-d119f64ed8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3a1bce-6bd1-4d12-bf93-d119f64ed8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1074627380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c514be-e53d-44e6-8408-476c0b75e78c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='73a2136983b54955a7c4661bafa69e6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:46Z,use_quota=True,user_id='7df78c0425ad477d9a34a0ee5cbefce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f148aa-aa40-4859-8b80-1fdfa2d96664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f148aa-aa40-4859-8b80-1fdfa2d96664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827e3060-fc0a-44a6-83a3-6f5a9631754c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827e3060-fc0a-44a6-83a3-6f5a9631754c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c514be-e53d-44e6-8408-476c0b75e78c', 'volume_name': 'volume-41c514be-e53d-44e6-8408-476c0b75e78c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b78b529-a443-4685-ad4d-dde50541f5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b78b529-a443-4685-ad4d-dde50541f5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa34848-d7fb-4898-9a9b-e7bb68b1e50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Volume 41c514be-e53d-44e6-8408-476c0b75e78c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c514be-e53d-44e6-8408-476c0b75e78c', 'volume_size': 1}
Sep 25 15:07:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:46 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73abf328-18a8-41a9-a10d-7d6567cd6283 1073741824" returned: 0 in 0.584s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73abf328-18a8-41a9-a10d-7d6567cd6283 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:46 devstack sudo[97940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73abf328-18a8-41a9-a10d-7d6567cd6283
Sep 25 15:07:46 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:46 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73abf328-18a8-41a9-a10d-7d6567cd6283" returned: 0 in 0.313s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.730s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1074627380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c514be-e53d-44e6-8408-476c0b75e78c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='73a2136983b54955a7c4661bafa69e6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:46Z,use_quota=True,user_id='7df78c0425ad477d9a34a0ee5cbefce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Creating volume 41c514be-e53d-44e6-8408-476c0b75e78c {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:07:46 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-41c514be-e53d-44e6-8408-476c0b75e78c 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2040f34-d905-4458-aae3-b4fc7c79df85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73abf328-18a8-41a9-a10d-7d6567cd6283', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:46 devstack sudo[97943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-41c514be-e53d-44e6-8408-476c0b75e78c 1073741824
Sep 25 15:07:46 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea87f7a8-7e42-4021-9359-00f544c47726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:46 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Volume volume-73abf328-18a8-41a9-a10d-7d6567cd6283 (73abf328-18a8-41a9-a10d-7d6567cd6283): created successfully
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea87f7a8-7e42-4021-9359-00f544c47726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Flow 'volume_create_manager' (ff18890b-bb4a-4030-b8dd-dd3e53aac083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f011ce0e-9957-4dd8-abda-e0b1d571b351 tempest-VolumesListTestJSON-1578338060 None] Created volume successfully.
Sep 25 15:07:47 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-41c514be-e53d-44e6-8408-476c0b75e78c 1073741824" returned: 0 in 0.600s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-41c514be-e53d-44e6-8408-476c0b75e78c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:47 devstack sudo[97949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-41c514be-e53d-44e6-8408-476c0b75e78c
Sep 25 15:07:47 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:47 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-41c514be-e53d-44e6-8408-476c0b75e78c" returned: 0 in 0.337s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:07:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa34848-d7fb-4898-9a9b-e7bb68b1e50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c514be-e53d-44e6-8408-476c0b75e78c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a2f0d1-f4d8-4d5e-a451-556b168fccb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Volume volume-41c514be-e53d-44e6-8408-476c0b75e78c (41c514be-e53d-44e6-8408-476c0b75e78c): created successfully
Sep 25 15:07:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a2f0d1-f4d8-4d5e-a451-556b168fccb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Flow 'volume_create_manager' (c18151d8-d5a5-4b8c-a55d-4cf8aaf94d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:47 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c9ea630f-4f87-453d-b49d-7bf7f335f525 tempest-GroupSnapshotsV319Test-943999794 None] Group tempest-GroupSnapshotsV319Test-Group-1740830684: creating
Sep 25 15:07:47 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-d8935f88-4002-479a-bfda-6a2aa2694039 req-4fd57599-ed3c-419a-924f-808423437dfe tempest-VolumesGetTestJSON-630935498 None] Created volume successfully.
Sep 25 15:07:47 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c9ea630f-4f87-453d-b49d-7bf7f335f525 tempest-GroupSnapshotsV319Test-943999794 None] Group tempest-GroupSnapshotsV319Test-Group-1740830684: created successfully
Sep 25 15:07:47 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c9ea630f-4f87-453d-b49d-7bf7f335f525 tempest-GroupSnapshotsV319Test-943999794 None] Create group completed successfully.
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Flow 'volume_create_manager' (f0a8a0a6-0516-4903-a5d4-c16e3933c8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fee5e5-db1d-4e37-ad46-fcca8928ad56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fee5e5-db1d-4e37-ad46-fcca8928ad56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1260282927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987953ad-5679-47c4-81d8-e5052927c147,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a2dc3abe3946b08045300ea91a7eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:48Z,use_quota=True,user_id='14a330ddbe2948b2b49ea7d2d3f0588b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250b6f27-29bc-4bf1-b27e-5f95ed998342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250b6f27-29bc-4bf1-b27e-5f95ed998342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85acfa30-ac82-41e9-a48f-10143bcfedf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85acfa30-ac82-41e9-a48f-10143bcfedf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '987953ad-5679-47c4-81d8-e5052927c147', 'volume_name': 'volume-987953ad-5679-47c4-81d8-e5052927c147', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ee48d0-dca6-457f-84ac-57fba070eba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ee48d0-dca6-457f-84ac-57fba070eba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe849bb-14d5-4869-bd60-46da247400dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:48 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Volume 987953ad-5679-47c4-81d8-e5052927c147: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-987953ad-5679-47c4-81d8-e5052927c147', 'volume_size': 1}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1260282927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987953ad-5679-47c4-81d8-e5052927c147,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82a2dc3abe3946b08045300ea91a7eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:48Z,use_quota=True,user_id='14a330ddbe2948b2b49ea7d2d3f0588b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Creating volume 987953ad-5679-47c4-81d8-e5052927c147 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:07:48 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-987953ad-5679-47c4-81d8-e5052927c147 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:48 devstack sudo[97953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-987953ad-5679-47c4-81d8-e5052927c147 1073741824
Sep 25 15:07:48 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Acquiring lock "cinder-41c514be-e53d-44e6-8408-476c0b75e78c-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Lock "cinder-41c514be-e53d-44e6-8408-476c0b75e78c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Acquiring lock "cinder-quobyte-41c514be-e53d-44e6-8408-476c0b75e78c" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Lock "cinder-quobyte-41c514be-e53d-44e6-8408-476c0b75e78c" acquired by "delete_volume" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d03c03-eddf-4a90-b94e-b16d66de1e54]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-41c514be-e53d-44e6-8408-476c0b75e78c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:48 devstack sudo[97958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-41c514be-e53d-44e6-8408-476c0b75e78c
Sep 25 15:07:48 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:48 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-987953ad-5679-47c4-81d8-e5052927c147 1073741824" returned: 0 in 0.706s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-987953ad-5679-47c4-81d8-e5052927c147 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:49 devstack sudo[97960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-987953ad-5679-47c4-81d8-e5052927c147
Sep 25 15:07:49 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:49 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-41c514be-e53d-44e6-8408-476c0b75e78c" returned: 0 in 0.484s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-41c514be-e53d-44e6-8408-476c0b75e78c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:49 devstack sudo[97965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-41c514be-e53d-44e6-8408-476c0b75e78c
Sep 25 15:07:49 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:49 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-987953ad-5679-47c4-81d8-e5052927c147" returned: 0 in 0.365s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe849bb-14d5-4869-bd60-46da247400dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-987953ad-5679-47c4-81d8-e5052927c147', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd126b0-9d88-4d87-a9bc-782a159059c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:49 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Volume volume-987953ad-5679-47c4-81d8-e5052927c147 (987953ad-5679-47c4-81d8-e5052927c147): created successfully
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd126b0-9d88-4d87-a9bc-782a159059c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Flow 'volume_create_manager' (f0a8a0a6-0516-4903-a5d4-c16e3933c8e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-82f7a1dd-b55b-4d99-b136-704c40112427 tempest-VolumesListTestJSON-1578338060 None] Created volume successfully.
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Flow 'volume_create_manager' (28b38074-898c-45fe-b856-442f6cb23eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d8f088-f1ae-4f91-aff8-5463496e8c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d8f088-f1ae-4f91-aff8-5463496e8c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1837429568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=266951d3-8be0-4c63-ac8e-c54d93f5fcf4,host='devstack@QuobyteHD#QuobyteHD',id=1846f31a-f469-45da-9e02-09a3ffd54fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669f0bb0f536451d854fce18fa73752a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:49Z,use_quota=True,user_id='5ca0952a3c164828b21122a1669aebf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b2bcc6e-baa0-47ad-9e8d-fb8c70665e20),volume_type_id=7b2bcc6e-baa0-47ad-9e8d-fb8c70665e20)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0c4a8f-c1a4-4a7e-b654-ab77c538aca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0c4a8f-c1a4-4a7e-b654-ab77c538aca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ac2219-ae30-44e3-8e60-87843b2d1b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ac2219-ae30-44e3-8e60-87843b2d1b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1846f31a-f469-45da-9e02-09a3ffd54fd7', 'volume_name': 'volume-1846f31a-f469-45da-9e02-09a3ffd54fd7', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9461ba62-a14d-4b42-85cd-9db62222627e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9461ba62-a14d-4b42-85cd-9db62222627e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e042d0a-31af-4b4d-ab75-a6e3fb0f0783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:49 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Volume 1846f31a-f469-45da-9e02-09a3ffd54fd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1846f31a-f469-45da-9e02-09a3ffd54fd7', 'volume_size': 1}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=266951d3-8be0-4c63-ac8e-c54d93f5fcf4,created_at=2026-09-25T13:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1837429568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=266951d3-8be0-4c63-ac8e-c54d93f5fcf4,host='devstack@QuobyteHD#QuobyteHD',id=1846f31a-f469-45da-9e02-09a3ffd54fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669f0bb0f536451d854fce18fa73752a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:49Z,use_quota=True,user_id='5ca0952a3c164828b21122a1669aebf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b2bcc6e-baa0-47ad-9e8d-fb8c70665e20),volume_type_id=7b2bcc6e-baa0-47ad-9e8d-fb8c70665e20)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Creating volume 1846f31a-f469-45da-9e02-09a3ffd54fd7 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:49 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:07:49 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-41c514be-e53d-44e6-8408-476c0b75e78c" returned: 0 in 0.394s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:49 devstack sudo[97969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7 1073741824
Sep 25 15:07:49 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Lock "cinder-quobyte-41c514be-e53d-44e6-8408-476c0b75e78c" released by "delete_volume" :: held 0.943s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.quota [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Created reservations ['bbbb3aa9-e6d6-4d2d-978a-669e79cd400d', 'df3143d2-ba12-47c2-ad56-ae0aa765965b', 'ee9020f0-0b5f-4219-8e64-f0a5f71c84c0', '0292947d-43c7-47d4-8ecd-232410aebd4f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:49 devstack sudo[97971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:07:49 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:50 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.369s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:50 devstack cinder-volume[87071]: DEBUG cinder.manager [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:07:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Deleted volume successfully.
Sep 25 15:07:50 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7 1073741824" returned: 0 in 0.626s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-bfc8a6a4-ec2d-4904-8774-ae95a10e19a7 req-cd97ef1e-12ae-45f8-9d52-43950b592ce9 tempest-VolumesGetTestJSON-630935498 None] Lock "cinder-41c514be-e53d-44e6-8408-476c0b75e78c-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:50 devstack sudo[97979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7
Sep 25 15:07:50 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:50 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7" returned: 0 in 0.323s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:07:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e042d0a-31af-4b4d-ab75-a6e3fb0f0783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1846f31a-f469-45da-9e02-09a3ffd54fd7', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc926dee-6a18-494f-9140-35f74aa467a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:50 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Volume volume-1846f31a-f469-45da-9e02-09a3ffd54fd7 (1846f31a-f469-45da-9e02-09a3ffd54fd7): created successfully
Sep 25 15:07:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc926dee-6a18-494f-9140-35f74aa467a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Flow 'volume_create_manager' (28b38074-898c-45fe-b856-442f6cb23eb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-cf7185b3-559f-42ca-9108-de94aed83e0b tempest-GroupSnapshotsV319Test-943999794 None] Created volume successfully.
Sep 25 15:07:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] GroupSnapshot 4f0e14c7-4d90-4f9f-9e75-dd4e1c75903f: creating.
Sep 25 15:07:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] Group snapshot 4f0e14c7-4d90-4f9f-9e75-dd4e1c75903f: creating. {{(pid=87071) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 25 15:07:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] Creating offline snapshot d720e83c-0d8e-4dc9-945c-1cdd004cf7ba of volume 1846f31a-f469-45da-9e02-09a3ffd54fd7 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:07:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c993e601-ae9d-4db5-8c8f-6d7c43356167]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:52 devstack sudo[97982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7
Sep 25 15:07:52 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:52 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7" returned: 0 in 0.644s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:53 devstack sudo[97989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba 1G
Sep 25 15:07:53 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Acquiring lock "cinder-987953ad-5679-47c4-81d8-e5052927c147-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Lock "cinder-987953ad-5679-47c4-81d8-e5052927c147-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Acquiring lock "cinder-quobyte-987953ad-5679-47c4-81d8-e5052927c147" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Lock "cinder-quobyte-987953ad-5679-47c4-81d8-e5052927c147" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1c11fc-0074-4aa9-ae55-1b247a44689b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-987953ad-5679-47c4-81d8-e5052927c147 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:53 devstack sudo[97991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-987953ad-5679-47c4-81d8-e5052927c147
Sep 25 15:07:53 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:53 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba 1G" returned: 0 in 0.644s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1846f31a-f469-45da-9e02-09a3ffd54fd7 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:53 devstack sudo[97997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1846f31a-f469-45da-9e02-09a3ffd54fd7 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba
Sep 25 15:07:53 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:53 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-987953ad-5679-47c4-81d8-e5052927c147" returned: 0 in 0.590s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-987953ad-5679-47c4-81d8-e5052927c147 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:53 devstack sudo[98002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-987953ad-5679-47c4-81d8-e5052927c147
Sep 25 15:07:53 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:54 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1846f31a-f469-45da-9e02-09a3ffd54fd7 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba" returned: 0 in 0.542s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:54 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:54 devstack sudo[98008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba
Sep 25 15:07:54 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:54 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-987953ad-5679-47c4-81d8-e5052927c147" returned: 0 in 0.404s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Lock "cinder-quobyte-987953ad-5679-47c4-81d8-e5052927c147" released by "delete_volume" :: held 1.057s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Created reservations ['c2631ecd-c85f-40e7-ab28-893ae00174e7', '571db344-b0ab-47ae-9f2b-2cca5dfcfaa2', '94c97641-5b32-4c79-bda0-160e9f1bae42', '85a4f130-a18d-4d3c-9f03-f37f1f416475'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:54 devstack sudo[98016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:07:54 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:54 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba" returned: 0 in 0.427s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:54 devstack sudo[98019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.info
Sep 25 15:07:54 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:54 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.355s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:07:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Deleted volume successfully.
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd7c9ced-72f3-47fc-abe9-c1170cce959a tempest-VolumesListTestJSON-1578338060 None] Lock "cinder-987953ad-5679-47c4-81d8-e5052927c147-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:54 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.info" returned: 0 in 0.341s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:54 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 15:07:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:54 devstack sudo[98023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.info
Sep 25 15:07:54 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Flow 'volume_create_manager' (a7922a60-504d-4ed0-8c60-a8da42c228f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82324c04-2967-4d81-8072-7dbe91e32ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:55 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82324c04-2967-4d81-8072-7dbe91e32ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1916072580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87d4493-227a-479b-9d85-1b6154240e10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffdac6353d76412a96bf9097aed8c91b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:55Z,use_quota=True,user_id='02251394959b46dd8add9a3e78cf69b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e1910a-cb74-446c-a3f4-5e410c2508f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e1910a-cb74-446c-a3f4-5e410c2508f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f8a7d8-a3b0-40d1-b6f1-dad12338503f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f8a7d8-a3b0-40d1-b6f1-dad12338503f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd87d4493-227a-479b-9d85-1b6154240e10', 'volume_name': 'volume-d87d4493-227a-479b-9d85-1b6154240e10', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ce11d3-e193-4131-88dc-db1015530c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ce11d3-e193-4131-88dc-db1015530c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce79ad6-12d1-4d74-88d3-8bf8f70ce3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:55 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Volume d87d4493-227a-479b-9d85-1b6154240e10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d87d4493-227a-479b-9d85-1b6154240e10', 'volume_size': 1}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.info" returned: 0 in 0.339s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.075s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.034s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1916072580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87d4493-227a-479b-9d85-1b6154240e10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffdac6353d76412a96bf9097aed8c91b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:55Z,use_quota=True,user_id='02251394959b46dd8add9a3e78cf69b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Creating volume d87d4493-227a-479b-9d85-1b6154240e10 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:07:55 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d87d4493-227a-479b-9d85-1b6154240e10 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:55 devstack sudo[98026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d87d4493-227a-479b-9d85-1b6154240e10 1073741824
Sep 25 15:07:55 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-86da546b-a9f8-4cfa-ad6a-061c0ac46513 tempest-GroupSnapshotsV319Test-943999794 None] group_snapshot 4f0e14c7-4d90-4f9f-9e75-dd4e1c75903f: created successfully
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Acquiring lock "cinder-73abf328-18a8-41a9-a10d-7d6567cd6283-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Lock "cinder-73abf328-18a8-41a9-a10d-7d6567cd6283-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Acquiring lock "cinder-quobyte-73abf328-18a8-41a9-a10d-7d6567cd6283" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Lock "cinder-quobyte-73abf328-18a8-41a9-a10d-7d6567cd6283" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aa1716-ae90-413b-887c-f49229d8ac73]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73abf328-18a8-41a9-a10d-7d6567cd6283 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:55 devstack sudo[98028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73abf328-18a8-41a9-a10d-7d6567cd6283
Sep 25 15:07:55 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:55 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d87d4493-227a-479b-9d85-1b6154240e10 1073741824" returned: 0 in 0.558s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d87d4493-227a-479b-9d85-1b6154240e10 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:55 devstack sudo[98039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d87d4493-227a-479b-9d85-1b6154240e10
Sep 25 15:07:55 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:56 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73abf328-18a8-41a9-a10d-7d6567cd6283" returned: 0 in 0.446s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73abf328-18a8-41a9-a10d-7d6567cd6283 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:56 devstack sudo[98042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73abf328-18a8-41a9-a10d-7d6567cd6283
Sep 25 15:07:56 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:56 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d87d4493-227a-479b-9d85-1b6154240e10" returned: 0 in 0.356s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce79ad6-12d1-4d74-88d3-8bf8f70ce3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d87d4493-227a-479b-9d85-1b6154240e10', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28726362-1548-499e-bc4b-75174d211871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:56 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Volume volume-d87d4493-227a-479b-9d85-1b6154240e10 (d87d4493-227a-479b-9d85-1b6154240e10): created successfully
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28726362-1548-499e-bc4b-75174d211871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Flow 'volume_create_manager' (a7922a60-504d-4ed0-8c60-a8da42c228f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-323a98b4-bab5-445e-b315-fc26379c14ce tempest-VolumesTestJSON-1337087347 None] Created volume successfully.
Sep 25 15:07:56 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73abf328-18a8-41a9-a10d-7d6567cd6283" returned: 0 in 0.381s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Lock "cinder-quobyte-73abf328-18a8-41a9-a10d-7d6567cd6283" released by "delete_volume" :: held 0.888s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Created reservations ['bcf4e859-a030-4a6c-9117-cd929b608905', '3b9238c5-fa78-4931-b447-b3b2a30cf8cf', 'd29f23f4-7578-4703-a32b-47b7b1b67346', '464e3307-5475-4ed4-a04d-fe4d6ef54a75'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:56 devstack sudo[98060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:07:56 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Acquiring lock "cinder-5481e9d5-5027-4a60-a954-e99380938110-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Lock "cinder-5481e9d5-5027-4a60-a954-e99380938110-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Acquiring lock "cinder-quobyte-5481e9d5-5027-4a60-a954-e99380938110" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Lock "cinder-quobyte-5481e9d5-5027-4a60-a954-e99380938110" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:57 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.414s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[284714df-5f49-449c-a2da-4d0290c1ab23]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Deleted volume successfully.
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5481e9d5-5027-4a60-a954-e99380938110 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-022891a4-f5ee-4ef3-93a3-5694f13fbad3 tempest-VolumesListTestJSON-1578338060 None] Lock "cinder-73abf328-18a8-41a9-a10d-7d6567cd6283-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] group_snapshot 4f0e14c7-4d90-4f9f-9e75-dd4e1c75903f: deleting
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] group_snapshot 4f0e14c7-4d90-4f9f-9e75-dd4e1c75903f: deleting {{(pid=87071) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 25 15:07:57 devstack sudo[98083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5481e9d5-5027-4a60-a954-e99380938110
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] Acquiring lock "cinder-quobyte-1846f31a-f469-45da-9e02-09a3ffd54fd7" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:57 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] Lock "cinder-quobyte-1846f31a-f469-45da-9e02-09a3ffd54fd7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] Acquiring lock "cinder-quobyte-d720e83c-0d8e-4dc9-945c-1cdd004cf7ba" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] Lock "cinder-quobyte-d720e83c-0d8e-4dc9-945c-1cdd004cf7ba" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] Deleting offline snapshot d720e83c-0d8e-4dc9-945c-1cdd004cf7ba of volume 1846f31a-f469-45da-9e02-09a3ffd54fd7 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] snapshot_file for this snap is: volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9803c0c-14a9-49d7-97d5-c4de1c633c6f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:57 devstack sudo[98088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba
Sep 25 15:07:57 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:57 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5481e9d5-5027-4a60-a954-e99380938110" returned: 0 in 0.674s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5481e9d5-5027-4a60-a954-e99380938110 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:57 devstack sudo[98094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5481e9d5-5027-4a60-a954-e99380938110
Sep 25 15:07:57 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:58 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5481e9d5-5027-4a60-a954-e99380938110" returned: 0 in 0.447s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:58 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Lock "cinder-quobyte-5481e9d5-5027-4a60-a954-e99380938110" released by "delete_volume" :: held 1.225s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba" returned: 0 in 0.760s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1846f31a-f469-45da-9e02-09a3ffd54fd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dc22fc-55df-40f1-a3df-5987b18de557]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Created reservations ['bd31e1db-7b64-41c5-99b1-d67358abe18f', 'e78dad8b-0669-4ada-a438-c096c45638e5', 'c6cd637f-758b-46de-b62a-4bb0155091e6', 'ab1e93bc-63c5-453a-96ed-be1c2f6bf284'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:58 devstack sudo[98100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7
Sep 25 15:07:58 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:58 devstack sudo[98102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:07:58 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Flow 'volume_create_manager' (3d351fd9-ff0b-4114-86a8-8c05217662e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f03699-ef9d-4533-b8ce-2b2f38cda137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f03699-ef9d-4533-b8ce-2b2f38cda137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1506860806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c413a427-5811-4f99-b170-f7fa344ee48f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffdac6353d76412a96bf9097aed8c91b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:59Z,use_quota=True,user_id='02251394959b46dd8add9a3e78cf69b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf87b27-2959-43bd-825b-f6bc97482dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf87b27-2959-43bd-825b-f6bc97482dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6486a08f-bf27-47a6-b14e-ba03195094f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6486a08f-bf27-47a6-b14e-ba03195094f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c413a427-5811-4f99-b170-f7fa344ee48f', 'volume_name': 'volume-c413a427-5811-4f99-b170-f7fa344ee48f', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0069a07c-acb1-4333-a176-9a73a5d9246e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0069a07c-acb1-4333-a176-9a73a5d9246e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209113a6-7083-492c-b1b6-37978f655745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:07:58 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Volume c413a427-5811-4f99-b170-f7fa344ee48f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c413a427-5811-4f99-b170-f7fa344ee48f', 'volume_size': 1}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1506860806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c413a427-5811-4f99-b170-f7fa344ee48f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffdac6353d76412a96bf9097aed8c91b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:07:59Z,use_quota=True,user_id='02251394959b46dd8add9a3e78cf69b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Creating volume c413a427-5811-4f99-b170-f7fa344ee48f {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:07:58 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:07:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c413a427-5811-4f99-b170-f7fa344ee48f 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:59 devstack sudo[98104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c413a427-5811-4f99-b170-f7fa344ee48f 1073741824
Sep 25 15:07:59 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:59 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.420s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:59 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:07:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Deleted volume successfully.
Sep 25 15:07:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-21413298-d294-4a45-8318-5b0a85231f4c tempest-VolumesListTestJSON-1578338060 None] Lock "cinder-5481e9d5-5027-4a60-a954-e99380938110-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:07:59 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7" returned: 0 in 0.788s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:59 devstack sudo[98110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba
Sep 25 15:07:59 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:59 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c413a427-5811-4f99-b170-f7fa344ee48f 1073741824" returned: 0 in 0.662s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c413a427-5811-4f99-b170-f7fa344ee48f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:59 devstack sudo[98120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c413a427-5811-4f99-b170-f7fa344ee48f
Sep 25 15:07:59 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:07:59 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root
Sep 25 15:07:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba" returned: 0 in 0.599s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:07:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:07:59 devstack sudo[98122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba
Sep 25 15:07:59 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:00 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c413a427-5811-4f99-b170-f7fa344ee48f" returned: 0 in 0.408s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:08:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209113a6-7083-492c-b1b6-37978f655745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c413a427-5811-4f99-b170-f7fa344ee48f', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a2bff1-b018-468a-94fe-a59a9fa8a9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:00 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Volume volume-c413a427-5811-4f99-b170-f7fa344ee48f (c413a427-5811-4f99-b170-f7fa344ee48f): created successfully
Sep 25 15:08:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a2bff1-b018-468a-94fe-a59a9fa8a9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Flow 'volume_create_manager' (3d351fd9-ff0b-4114-86a8-8c05217662e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:08:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1ab06607-90b7-4310-bb23-f98ae3b5d09d tempest-VolumesTestJSON-1337087347 None] Created volume successfully.
Sep 25 15:08:00 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7.d720e83c-0d8e-4dc9-945c-1cdd004cf7ba" returned: 0 in 0.501s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] Lock "cinder-quobyte-d720e83c-0d8e-4dc9-945c-1cdd004cf7ba" released by "_delete_snapshot" :: held 2.848s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] Lock "cinder-quobyte-1846f31a-f469-45da-9e02-09a3ffd54fd7" released by "delete_snapshot" :: held 2.886s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:00 devstack cinder-volume[87071]: WARNING cinder.quota [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1679813674 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1679813674, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:08:00 devstack cinder-volume[87071]: WARNING cinder.quota [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1679813674 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1679813674, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:08:00 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] Created reservations ['53b44f14-fa5b-4806-94b0-59203a7471a0', 'e0ece527-1ade-4b06-8ba0-e68cdcc426ce', '9919b64b-352c-49e4-9456-f51d0a10f5b3', '0d8bcbca-c16a-411f-9c90-66a1b3966710'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:08:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-346bc8ea-46dd-4279-9f68-81b245ac1d75 tempest-GroupSnapshotsV319Test-943999794 None] group_snapshot 4f0e14c7-4d90-4f9f-9e75-dd4e1c75903f: deleted successfully
Sep 25 15:08:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] Acquiring lock "cinder-quobyte-1846f31a-f469-45da-9e02-09a3ffd54fd7" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:01 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:08:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Flow 'volume_create_manager' (7949f515-7083-48f9-882c-00339823542a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:08:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a979c83-43ac-4af5-93fa-4978b37d9f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] Lock "cinder-quobyte-1846f31a-f469-45da-9e02-09a3ffd54fd7" acquired by "delete_volume" :: waited 0.079s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a979c83-43ac-4af5-93fa-4978b37d9f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-477365927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f900306d-fa9f-4c1f-b28b-c81ea12dfb3d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffdac6353d76412a96bf9097aed8c91b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:08:02Z,use_quota=True,user_id='02251394959b46dd8add9a3e78cf69b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef441c81-a925-4804-9ad5-6b35f829b41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef441c81-a925-4804-9ad5-6b35f829b41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad82cec-74a8-4367-b948-49ec2de82d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ad82cec-74a8-4367-b948-49ec2de82d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f900306d-fa9f-4c1f-b28b-c81ea12dfb3d', 'volume_name': 'volume-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ba0c2e-9d8f-4ab3-96da-dcf2ac7de878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ba0c2e-9d8f-4ab3-96da-dcf2ac7de878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1822645c-3989-4b59-a5dd-cc756c6325f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:02 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Volume f900306d-fa9f-4c1f-b28b-c81ea12dfb3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d', 'volume_size': 1}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-477365927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f900306d-fa9f-4c1f-b28b-c81ea12dfb3d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffdac6353d76412a96bf9097aed8c91b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:08:02Z,use_quota=True,user_id='02251394959b46dd8add9a3e78cf69b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Creating volume f900306d-fa9f-4c1f-b28b-c81ea12dfb3d {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:08:02 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[678045e5-828b-46bf-82d9-907118ef2cc3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:02 devstack sudo[98135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d 1073741824
Sep 25 15:08:02 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:02 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-7253b7f0-4016-433f-b027-a2e91da4274c req-4ae8ed3a-f799-4ffb-96a7-05984ab7c3ad tempest-TestMinimumBasicScenario-280967217 None] Terminate volume connection completed successfully.
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-7253b7f0-4016-433f-b027-a2e91da4274c req-4ae8ed3a-f799-4ffb-96a7-05984ab7c3ad tempest-TestMinimumBasicScenario-280967217 None] Deleting attachment 3d91e54b-9b60-4213-a570-4841737a4750. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:08:02 devstack sudo[98136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7
Sep 25 15:08:02 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:02 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7" returned: 0 in 0.570s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:02 devstack sudo[98146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7
Sep 25 15:08:02 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:02 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d 1073741824" returned: 0 in 0.700s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:02 devstack sudo[98148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d
Sep 25 15:08:02 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:03 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1846f31a-f469-45da-9e02-09a3ffd54fd7" returned: 0 in 0.368s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] Lock "cinder-quobyte-1846f31a-f469-45da-9e02-09a3ffd54fd7" released by "delete_volume" :: held 1.171s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:03 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d" returned: 0 in 0.389s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] Created reservations ['02b570f4-5fc0-40cb-a3b4-a51c3b392540'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1822645c-3989-4b59-a5dd-cc756c6325f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfe9514-6ce0-42a1-b91b-7fba6b4affbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:03 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Volume volume-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d (f900306d-fa9f-4c1f-b28b-c81ea12dfb3d): created successfully
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfe9514-6ce0-42a1-b91b-7fba6b4affbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Flow 'volume_create_manager' (7949f515-7083-48f9-882c-00339823542a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:08:03 devstack cinder-volume[87071]: WARNING cinder.quota [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1679813674 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1679813674, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:08:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8eda7e1a-a70d-45a7-966c-c0c92f1e7d1f tempest-VolumesTestJSON-1337087347 None] Created volume successfully.
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] Created reservations ['1e0bea0f-fc35-48c3-bb30-9bf1057dda7b', 'b3a1948a-da7d-4481-b9e5-6cdc96db32cd', 'dbe73cc9-ffee-42b9-8951-44d664880471', '50597952-c8f4-4dee-b144-a7f0adc0908d'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Acquiring lock "cinder-279e5b3e-d550-4370-a9e2-d00eee477ba5-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Lock "cinder-279e5b3e-d550-4370-a9e2-d00eee477ba5-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Acquiring lock "cinder-quobyte-279e5b3e-d550-4370-a9e2-d00eee477ba5" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Lock "cinder-quobyte-279e5b3e-d550-4370-a9e2-d00eee477ba5" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2c3620-605e-4366-b257-5d50e0082dbb]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-279e5b3e-d550-4370-a9e2-d00eee477ba5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:03 devstack sudo[98153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:08:03 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:03 devstack sudo[98152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-279e5b3e-d550-4370-a9e2-d00eee477ba5
Sep 25 15:08:03 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:04 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.346s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:04 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:08:04 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-feb45ab2-a2ce-48d6-bb33-03a16695ca96 tempest-GroupSnapshotsV319Test-943999794 None] Delete group completed successfully.
Sep 25 15:08:04 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-279e5b3e-d550-4370-a9e2-d00eee477ba5" returned: 0 in 0.614s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-279e5b3e-d550-4370-a9e2-d00eee477ba5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:04 devstack sudo[98160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-279e5b3e-d550-4370-a9e2-d00eee477ba5
Sep 25 15:08:04 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:04 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-279e5b3e-d550-4370-a9e2-d00eee477ba5" returned: 0 in 0.380s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Lock "cinder-quobyte-279e5b3e-d550-4370-a9e2-d00eee477ba5" released by "delete_volume" :: held 1.079s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:04 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Created reservations ['69445833-d51e-4d57-b320-4279e6ad308e', 'e17c370b-4e65-4b3f-8173-80d12562da85', '60382434-a09d-4ea5-8359-2fc14bf4badf', '5f755359-b59f-4f1e-bd85-3b06d850f4d7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:08:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:08:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:08:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:05 devstack sudo[98163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:08:05 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:05 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.357s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:05 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:08:05 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Deleted volume successfully.
Sep 25 15:08:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dc4bb409-5460-41bb-b5e6-c416a9807fb6 tempest-TestMinimumBasicScenario-280967217 None] Lock "cinder-279e5b3e-d550-4370-a9e2-d00eee477ba5-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Acquiring lock "cinder-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Lock "cinder-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Acquiring lock "cinder-quobyte-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Lock "cinder-quobyte-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:05 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f7beca-78d2-4ee4-8042-f21c79a02924]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:05 devstack sudo[98166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d
Sep 25 15:08:05 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:06 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d" returned: 0 in 0.763s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:06 devstack sudo[98174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d
Sep 25 15:08:06 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:06 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d" returned: 0 in 0.583s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Lock "cinder-quobyte-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d" released by "delete_volume" :: held 1.429s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:07 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Created reservations ['69ce7a50-1ff6-43d7-bd97-a02470d75a42', '45c4ec75-af55-4e90-836c-c05b9cdbaea9', 'c78675af-b182-41fa-a50e-7ce8897c3a12', '91308307-61da-4ec2-9b0c-ff5b7321ab09'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:08:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:08:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:08:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:07 devstack sudo[98199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:08:07 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:07 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.300s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:07 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:08:07 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Deleted volume successfully.
Sep 25 15:08:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-07df88ba-4612-47e7-9106-a2263b7da674 tempest-VolumesTestJSON-1337087347 None] Lock "cinder-f900306d-fa9f-4c1f-b28b-c81ea12dfb3d-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Acquiring lock "cinder-c413a427-5811-4f99-b170-f7fa344ee48f-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Lock "cinder-c413a427-5811-4f99-b170-f7fa344ee48f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Acquiring lock "cinder-quobyte-c413a427-5811-4f99-b170-f7fa344ee48f" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Lock "cinder-quobyte-c413a427-5811-4f99-b170-f7fa344ee48f" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:07 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[04069b3b-d4e7-4baf-a45c-0cb83219ccab]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c413a427-5811-4f99-b170-f7fa344ee48f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:08 devstack sudo[98203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c413a427-5811-4f99-b170-f7fa344ee48f
Sep 25 15:08:08 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:08 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c413a427-5811-4f99-b170-f7fa344ee48f" returned: 0 in 0.618s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c413a427-5811-4f99-b170-f7fa344ee48f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:08 devstack sudo[98212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c413a427-5811-4f99-b170-f7fa344ee48f
Sep 25 15:08:08 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:09 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c413a427-5811-4f99-b170-f7fa344ee48f" returned: 0 in 0.439s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Lock "cinder-quobyte-c413a427-5811-4f99-b170-f7fa344ee48f" released by "delete_volume" :: held 1.142s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:09 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Created reservations ['03ae8e0c-5abd-4334-8765-2323c233419d', '11b74353-a0f6-4743-b0cf-3cfc17de3988', '9c92c713-8e81-457d-b28f-31ec69de1d14', '02d64f81-1934-4030-bdd6-072a275d9928'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:08:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:08:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:08:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:09 devstack sudo[98216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:08:09 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:09 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.462s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:09 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:08:09 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Deleted volume successfully.
Sep 25 15:08:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6bf3624c-1fde-47c0-8491-85367a306177 tempest-VolumesTestJSON-1337087347 None] Lock "cinder-c413a427-5811-4f99-b170-f7fa344ee48f-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Acquiring lock "cinder-d87d4493-227a-479b-9d85-1b6154240e10-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Lock "cinder-d87d4493-227a-479b-9d85-1b6154240e10-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Acquiring lock "cinder-quobyte-d87d4493-227a-479b-9d85-1b6154240e10" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Lock "cinder-quobyte-d87d4493-227a-479b-9d85-1b6154240e10" acquired by "delete_volume" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:10 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c9d41d-10d6-4695-a093-4f32cd9ab91e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d87d4493-227a-479b-9d85-1b6154240e10 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:10 devstack sudo[98219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d87d4493-227a-479b-9d85-1b6154240e10
Sep 25 15:08:10 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:11 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d87d4493-227a-479b-9d85-1b6154240e10" returned: 0 in 0.545s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d87d4493-227a-479b-9d85-1b6154240e10 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:11 devstack sudo[98225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d87d4493-227a-479b-9d85-1b6154240e10
Sep 25 15:08:11 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:11 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d87d4493-227a-479b-9d85-1b6154240e10" returned: 0 in 0.427s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Lock "cinder-quobyte-d87d4493-227a-479b-9d85-1b6154240e10" released by "delete_volume" :: held 1.058s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:11 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Created reservations ['136c3f31-42bf-4539-845f-b884c413ccf1', 'bfaf8228-d0e4-48cb-a5d2-2fc033490444', '82c587ad-23b4-455d-aecd-1249ee889bcd', '517285db-e1d6-4269-aef6-2426db66bdfd'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:08:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:08:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:08:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:11 devstack sudo[98228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:08:11 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:12 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.416s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:12 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:08:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Deleted volume successfully.
Sep 25 15:08:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dbff151a-8662-4bba-b200-df3554dda78d tempest-VolumesTestJSON-1337087347 None] Lock "cinder-d87d4493-227a-479b-9d85-1b6154240e10-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:08:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:08:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:08:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:20 devstack sudo[98236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:08:20 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:21 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.443s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:08:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:08:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:08:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:08:21 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=132,cinder:SELECT=116,cinder:INSERT=28,cinder:DELETE=8 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:08:22 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=90,cinder:INSERT=36,cinder:UPDATE=138,cinder:DELETE=9 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Flow 'volume_create_manager' (14c4c709-0ab9-447b-a360-79610e193456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14db0634-0dae-4489-b000-aac5dd7749d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14db0634-0dae-4489-b000-aac5dd7749d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1176227433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4986c42e-f601-4b96-a677-f274230040cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8344c06e0c8b4bce89e92bae73929d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:08:25Z,use_quota=True,user_id='9a7d3786e7154231a065362de14b35e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974ee0ce-561f-494a-afaf-702b10e352ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974ee0ce-561f-494a-afaf-702b10e352ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac43bf59-436d-4caf-ab2b-3e51ff3d14ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac43bf59-436d-4caf-ab2b-3e51ff3d14ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4986c42e-f601-4b96-a677-f274230040cf', 'volume_name': 'volume-4986c42e-f601-4b96-a677-f274230040cf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b113c5e-55aa-4c5e-9881-afcbd3fc6ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b113c5e-55aa-4c5e-9881-afcbd3fc6ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2584aa-d1c8-4ab7-9191-97fa7a206e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:25 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Volume 4986c42e-f601-4b96-a677-f274230040cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4986c42e-f601-4b96-a677-f274230040cf', 'volume_size': 1}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1176227433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4986c42e-f601-4b96-a677-f274230040cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8344c06e0c8b4bce89e92bae73929d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:08:25Z,use_quota=True,user_id='9a7d3786e7154231a065362de14b35e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Creating volume 4986c42e-f601-4b96-a677-f274230040cf {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:08:25 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:08:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:25 devstack sudo[98240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf 1073741824
Sep 25 15:08:25 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:26 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf 1073741824" returned: 0 in 0.725s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:26 devstack sudo[98246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf
Sep 25 15:08:26 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:26 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf" returned: 0 in 0.344s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:08:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2584aa-d1c8-4ab7-9191-97fa7a206e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4986c42e-f601-4b96-a677-f274230040cf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf68acc-a134-4ce5-bf48-ff5029b966eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:26 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Volume volume-4986c42e-f601-4b96-a677-f274230040cf (4986c42e-f601-4b96-a677-f274230040cf): created successfully
Sep 25 15:08:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf68acc-a134-4ce5-bf48-ff5029b966eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Flow 'volume_create_manager' (14c4c709-0ab9-447b-a360-79610e193456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:08:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1c856e5c-0564-4c49-a75f-2c4234017db5 tempest-VolumesSnapshotTestJSON-698939427 None] Created volume successfully.
Sep 25 15:08:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] Creating offline snapshot d24e5ea9-eab1-44aa-8625-470a73c1bfe8 of volume 4986c42e-f601-4b96-a677-f274230040cf {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:08:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8377ecab-5636-4107-a908-55d44471a105]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:28 devstack sudo[98250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf
Sep 25 15:08:28 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:28 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf" returned: 0 in 0.552s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:28 devstack sudo[98257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8 1G
Sep 25 15:08:28 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:29 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8 1G" returned: 0 in 0.645s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4986c42e-f601-4b96-a677-f274230040cf -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:29 devstack sudo[98263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4986c42e-f601-4b96-a677-f274230040cf -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8
Sep 25 15:08:29 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:29 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:08:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Flow 'volume_create_manager' (65216fc7-0ba5-48d3-b4c8-ed4da0fbb7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:08:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b80d8c-a782-44f5-9d28-6e7ddfc696f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b80d8c-a782-44f5-9d28-6e7ddfc696f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2137781710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e394cdf-d06d-4c29-aef9-c1a6594e5cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4163117830ff4de68024c534f0af54cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:08:30Z,use_quota=True,user_id='64e149f966154ae996fcd8761af13bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9164e516-3398-485b-bd74-d67f90e14979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9164e516-3398-485b-bd74-d67f90e14979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c51af8d-bc89-4ba7-92d6-e949eea9839b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c51af8d-bc89-4ba7-92d6-e949eea9839b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e394cdf-d06d-4c29-aef9-c1a6594e5cd1', 'volume_name': 'volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35193e2c-c910-4da3-b503-b8017ed5741b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35193e2c-c910-4da3-b503-b8017ed5741b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987c43ce-d758-4732-a999-f2571f38b95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:30 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Volume 0e394cdf-d06d-4c29-aef9-c1a6594e5cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1', 'volume_size': 1}
Sep 25 15:08:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:30 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4986c42e-f601-4b96-a677-f274230040cf -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8" returned: 0 in 0.458s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:30 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8 is being set with open permissions: ugo+rw
Sep 25 15:08:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:30 devstack sudo[98268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8
Sep 25 15:08:30 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-31a32e70-3b4f-466d-be5c-82c54f015004 tempest-GroupsV314Test-423311671 None] Group tempest-GroupsV314Test-Group-560218013: creating
Sep 25 15:08:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-31a32e70-3b4f-466d-be5c-82c54f015004 tempest-GroupsV314Test-423311671 None] Group tempest-GroupsV314Test-Group-560218013: created successfully
Sep 25 15:08:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-31a32e70-3b4f-466d-be5c-82c54f015004 tempest-GroupsV314Test-423311671 None] Create group completed successfully.
Sep 25 15:08:30 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8" returned: 0 in 0.319s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:30 devstack sudo[98271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.info
Sep 25 15:08:30 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:30 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.info" returned: 0 in 0.385s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:30 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.info is being set with open permissions: ugo+rw
Sep 25 15:08:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:30 devstack sudo[98274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.info
Sep 25 15:08:30 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:31 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.info" returned: 0 in 0.302s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.798s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.090s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2137781710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e394cdf-d06d-4c29-aef9-c1a6594e5cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4163117830ff4de68024c534f0af54cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:08:30Z,use_quota=True,user_id='64e149f966154ae996fcd8761af13bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Creating volume 0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:08:31 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:31 devstack sudo[98277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 1073741824
Sep 25 15:08:31 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a4e21778-aac7-4f52-b7c8-1d912a2b9d25 tempest-VolumesSnapshotTestJSON-698939427 None] Create snapshot completed successfully
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-d24e5ea9-eab1-44aa-8625-470a73c1bfe8-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-d24e5ea9-eab1-44aa-8625-470a73c1bfe8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-quobyte-4986c42e-f601-4b96-a677-f274230040cf" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-4986c42e-f601-4b96-a677-f274230040cf" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-quobyte-d24e5ea9-eab1-44aa-8625-470a73c1bfe8" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-d24e5ea9-eab1-44aa-8625-470a73c1bfe8" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Deleting offline snapshot d24e5ea9-eab1-44aa-8625-470a73c1bfe8 of volume 4986c42e-f601-4b96-a677-f274230040cf {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:08:32 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] snapshot_file for this snap is: volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 1073741824" returned: 0 in 0.894s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a8ec80-0ce1-46c4-935f-b9cf2210798f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:32 devstack sudo[98284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1
Sep 25 15:08:32 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:08:32 devstack sudo[98283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8
Sep 25 15:08:32 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Flow 'volume_create_manager' (bfdb5076-787e-4c1b-ac74-c5b74477129b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56df6ad0-fa4d-4132-af36-47ccc8b10139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56df6ad0-fa4d-4132-af36-47ccc8b10139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1028326573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=323cb68b-69b9-4d06-b356-83fd469d27d8,host='devstack@QuobyteHD#QuobyteHD',id=4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f1a8b4239345a3be4eb12f102f11d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:08:32Z,use_quota=True,user_id='d568c8740fe24fbbb38b82c956b154c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(563edc3d-11e2-43d3-b3cc-2203ac8f4f99),volume_type_id=563edc3d-11e2-43d3-b3cc-2203ac8f4f99)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef589824-e95f-4f99-9ba5-b669b8fcec32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef589824-e95f-4f99-9ba5-b669b8fcec32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f565e09a-f6d4-43c2-b759-dad3a12a8136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f565e09a-f6d4-43c2-b759-dad3a12a8136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3', 'volume_name': 'volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9902b4b1-e6b9-462c-9db7-21585dc0f1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9902b4b1-e6b9-462c-9db7-21585dc0f1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f004e8-e9ad-4189-ab18-618f9e9e71e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:32 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Volume 4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3', 'volume_size': 1}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:32 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" returned: 0 in 0.443s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.085s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=323cb68b-69b9-4d06-b356-83fd469d27d8,created_at=2026-09-25T13:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1028326573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=323cb68b-69b9-4d06-b356-83fd469d27d8,host='devstack@QuobyteHD#QuobyteHD',id=4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f1a8b4239345a3be4eb12f102f11d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:08:32Z,use_quota=True,user_id='d568c8740fe24fbbb38b82c956b154c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(563edc3d-11e2-43d3-b3cc-2203ac8f4f99),volume_type_id=563edc3d-11e2-43d3-b3cc-2203ac8f4f99)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Creating volume 4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:08:32 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987c43ce-d758-4732-a999-f2571f38b95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecca774-dd53-4ba7-a9f1-87dae6022222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:32 devstack sudo[98288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 1073741824
Sep 25 15:08:32 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:32 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Volume volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 (0e394cdf-d06d-4c29-aef9-c1a6594e5cd1): created successfully
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecca774-dd53-4ba7-a9f1-87dae6022222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Flow 'volume_create_manager' (65216fc7-0ba5-48d3-b4c8-ed4da0fbb7da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:08:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8b77f1c6-2fde-4686-a642-269d89a0f025 tempest-SnapshotsActionsTest-1298817753 None] Created volume successfully.
Sep 25 15:08:32 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8" returned: 0 in 0.708s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4986c42e-f601-4b96-a677-f274230040cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[69628596-1995-49a5-b6cc-0a00339137bc]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:33 devstack sudo[98293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf
Sep 25 15:08:33 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:33 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 1073741824" returned: 0 in 0.641s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:33 devstack sudo[98301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3
Sep 25 15:08:33 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:33 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf" returned: 0 in 0.596s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:33 devstack sudo[98304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8
Sep 25 15:08:33 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:33 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3" returned: 0 in 0.418s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:08:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.240s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f004e8-e9ad-4189-ab18-618f9e9e71e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28203add-6eb0-4225-aa37-9c75351ab713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] Creating offline snapshot b6665096-e96b-4ef6-bc8d-ddef2cd23361 of volume 0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:08:33 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Volume volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 (4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3): created successfully
Sep 25 15:08:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28203add-6eb0-4225-aa37-9c75351ab713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Flow 'volume_create_manager' (bfdb5076-787e-4c1b-ac74-c5b74477129b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:08:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02c3b4c-3fd5-4b51-bc3b-c2e2bcd18b91]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8e40111d-cb57-42ac-85e8-59ba907de350 tempest-GroupsV314Test-423311671 None] Created volume successfully.
Sep 25 15:08:34 devstack sudo[98309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1
Sep 25 15:08:34 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:34 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8" returned: 0 in 0.590s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:34 devstack sudo[98313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8
Sep 25 15:08:34 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:34 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf.d24e5ea9-eab1-44aa-8625-470a73c1bfe8" returned: 0 in 0.328s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:34 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" returned: 0 in 0.574s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-d24e5ea9-eab1-44aa-8625-470a73c1bfe8" released by "_delete_snapshot" :: held 2.425s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-4986c42e-f601-4b96-a677-f274230040cf" released by "delete_snapshot" :: held 2.467s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:34 devstack sudo[98319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 1G
Sep 25 15:08:34 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:34 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Created reservations ['56dfe534-4558-425b-bfb1-861eea24a10d', '6fc39367-f0d8-4e9f-bdda-6ad3a55eb740', 'c82948b8-a0b7-497c-b303-e8388e21a853', 'f43f470e-e356-47a6-91d0-1fa623e49b12'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:08:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Delete snapshot completed successfully.
Sep 25 15:08:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5044bc5b-56d9-4579-8e66-0d87db802d57 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-d24e5ea9-eab1-44aa-8625-470a73c1bfe8-delete_snapshot" released by "delete_snapshot" :: held 2.761s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:35 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 1G" returned: 0 in 0.614s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:35 devstack sudo[98326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361
Sep 25 15:08:35 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:35 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361" returned: 0 in 0.438s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:35 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 is being set with open permissions: ugo+rw
Sep 25 15:08:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:35 devstack sudo[98331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361
Sep 25 15:08:35 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:35 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361" returned: 0 in 0.357s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:35 devstack sudo[98334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.info
Sep 25 15:08:35 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Flow 'volume_create_manager' (6810957e-14cd-49ad-80f4-835644a3d676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13546646-6597-4855-a7a8-07106ec76a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13546646-6597-4855-a7a8-07106ec76a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1029310630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d540b826-74bb-43b8-ac59-b23747d42f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8344c06e0c8b4bce89e92bae73929d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:08:36Z,use_quota=True,user_id='9a7d3786e7154231a065362de14b35e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc9e1de-1056-4f8b-b8e2-79efb5d695b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc9e1de-1056-4f8b-b8e2-79efb5d695b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17dc15f-8392-4127-95d6-fd76fb656965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17dc15f-8392-4127-95d6-fd76fb656965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd540b826-74bb-43b8-ac59-b23747d42f42', 'volume_name': 'volume-d540b826-74bb-43b8-ac59-b23747d42f42', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950f6086-8324-4dfa-82fe-80622e1cb905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950f6086-8324-4dfa-82fe-80622e1cb905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0482a7ce-e578-44d6-b989-cbbcfa320d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:36 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Volume d540b826-74bb-43b8-ac59-b23747d42f42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d540b826-74bb-43b8-ac59-b23747d42f42', 'volume_size': 1}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:36 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.info" returned: 0 in 0.357s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:36 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.info is being set with open permissions: ugo+rw
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:36 devstack sudo[98337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.info
Sep 25 15:08:36 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:36 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.info" returned: 0 in 0.335s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.831s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.450s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1029310630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d540b826-74bb-43b8-ac59-b23747d42f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8344c06e0c8b4bce89e92bae73929d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:08:36Z,use_quota=True,user_id='9a7d3786e7154231a065362de14b35e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Creating volume d540b826-74bb-43b8-ac59-b23747d42f42 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:08:36 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:08:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:36 devstack sudo[98340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42 1073741824
Sep 25 15:08:36 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:36 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5c258987-b241-4050-ab62-9ab89082531f tempest-SnapshotsActionsTest-1298817753 None] Create snapshot completed successfully
Sep 25 15:08:37 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42 1073741824" returned: 0 in 0.679s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:37 devstack sudo[98347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42
Sep 25 15:08:37 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:37 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42" returned: 0 in 0.335s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:08:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.539s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:37 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Cloning volume 4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 to volume 856e6abb-089f-4eb8-b577-6cf41942070e
Sep 25 15:08:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0482a7ce-e578-44d6-b989-cbbcfa320d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d540b826-74bb-43b8-ac59-b23747d42f42', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6f28b8-66b0-4683-a5b9-dd72523cceca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:08:37 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Volume volume-d540b826-74bb-43b8-ac59-b23747d42f42 (d540b826-74bb-43b8-ac59-b23747d42f42): created successfully
Sep 25 15:08:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6f28b8-66b0-4683-a5b9-dd72523cceca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:08:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Flow 'volume_create_manager' (6810957e-14cd-49ad-80f4-835644a3d676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:08:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Creating offline snapshot 4194c901-f31c-44a7-be75-0ca643af8874 of volume 4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:08:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2060da46-96d5-4386-b733-27585ffe591e tempest-VolumesSnapshotTestJSON-698939427 None] Created volume successfully.
Sep 25 15:08:37 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aa35ed-b320-47c5-9918-267a0f0fedc1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3b5e4d32-5596-4b7a-ac50-ece0f8967abb tempest-SnapshotsActionsTest-1298817753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:38 devstack sudo[98350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3
Sep 25 15:08:38 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:38 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3" returned: 0 in 0.542s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:38 devstack sudo[98355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874 1G
Sep 25 15:08:38 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:39 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874 1G" returned: 0 in 0.574s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:39 devstack sudo[98361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874
Sep 25 15:08:39 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:39 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874" returned: 0 in 0.430s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:39 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 15:08:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:39 devstack sudo[98366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874
Sep 25 15:08:39 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:39 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874" returned: 0 in 0.297s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:39 devstack sudo[98369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.info
Sep 25 15:08:39 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:40 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.info" returned: 0 in 0.416s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:40 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 15:08:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:40 devstack sudo[98372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.info
Sep 25 15:08:40 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:40 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.info" returned: 0 in 0.336s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Acquiring lock "cinder-quobyte-856e6abb-089f-4eb8-b577-6cf41942070e" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Lock "cinder-quobyte-856e6abb-089f-4eb8-b577-6cf41942070e" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] snapshot: 4194c901-f31c-44a7-be75-0ca643af8874, volume: 856e6abb-089f-4eb8-b577-6cf41942070e,  {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 15:08:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:08:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:08:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:40 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f098b69f-9393-4198-a9dd-a50c8a0f7f69]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:40 devstack sudo[98375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874
Sep 25 15:08:40 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:41 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874" returned: 0 in 0.460s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:08:41 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[47070fbd-02d1-4bab-974a-10385a6f32ce]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:41 devstack sudo[98380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3
Sep 25 15:08:41 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:41 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3" returned: 0 in 0.567s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 15:08:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 15:08:41 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Path /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856e6abb-089f-4eb8-b577-6cf41942070e not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 15:08:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856e6abb-089f-4eb8-b577-6cf41942070e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:41 devstack sudo[98385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856e6abb-089f-4eb8-b577-6cf41942070e
Sep 25 15:08:41 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:49 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=36,cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:08:49 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=20,cinder:SELECT=33,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:08:50 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856e6abb-089f-4eb8-b577-6cf41942070e" returned: 0 in 8.937s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:50 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Image conversion details: src /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3, size 1024.00 MB, duration 8.94 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856e6abb-089f-4eb8-b577-6cf41942070e {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:08:50 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Converted 1024.00 MB image at 114.57 MB/s
Sep 25 15:08:50 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856e6abb-089f-4eb8-b577-6cf41942070e is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 15:08:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856e6abb-089f-4eb8-b577-6cf41942070e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:50 devstack sudo[98401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856e6abb-089f-4eb8-b577-6cf41942070e
Sep 25 15:08:50 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:51 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856e6abb-089f-4eb8-b577-6cf41942070e" returned: 0 in 0.316s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Lock "cinder-quobyte-856e6abb-089f-4eb8-b577-6cf41942070e" released by "_copy_volume_from_snapshot" :: held 10.382s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Acquiring lock "cinder-quobyte-4194c901-f31c-44a7-be75-0ca643af8874" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Lock "cinder-quobyte-4194c901-f31c-44a7-be75-0ca643af8874" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Deleting offline snapshot 4194c901-f31c-44a7-be75-0ca643af8874 of volume 4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:08:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] snapshot_file for this snap is: volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:08:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bc6316-8580-4e9c-b085-5e07edab435d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:51 devstack sudo[98404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874
Sep 25 15:08:51 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:51 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874" returned: 0 in 0.432s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:08:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f977dd1f-f43c-4198-ac06-5f0d63e92888]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:51 devstack sudo[98409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3
Sep 25 15:08:51 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:52 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3" returned: 0 in 0.566s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:52 devstack sudo[98414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874
Sep 25 15:08:52 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:52 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874" returned: 0 in 0.451s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:52 devstack sudo[98421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874
Sep 25 15:08:52 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:52 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3.4194c901-f31c-44a7-be75-0ca643af8874" returned: 0 in 0.282s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Lock "cinder-quobyte-4194c901-f31c-44a7-be75-0ca643af8874" released by "_delete_snapshot" :: held 1.877s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.311s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3b5e4d32-5596-4b7a-ac50-ece0f8967abb tempest-SnapshotsActionsTest-1298817753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.021s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3b5e4d32-5596-4b7a-ac50-ece0f8967abb tempest-SnapshotsActionsTest-1298817753 None] Creating offline snapshot 1407d373-d0ba-4083-9279-c568f8221c18 of volume 0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:08:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e391d3b0-22c7-4f87-9864-69f3cae92a6e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3b5e4d32-5596-4b7a-ac50-ece0f8967abb tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4267f7a0-a0cc-4a28-964a-ec557c3e3d89 tempest-GroupsV314Test-423311671 None] Create group from source-group-323cb68b-69b9-4d06-b356-83fd469d27d8 completed successfully.
Sep 25 15:08:53 devstack sudo[98424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361
Sep 25 15:08:53 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:53 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3b5e4d32-5596-4b7a-ac50-ece0f8967abb tempest-SnapshotsActionsTest-1298817753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361" returned: 0 in 0.446s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3b5e4d32-5596-4b7a-ac50-ece0f8967abb tempest-SnapshotsActionsTest-1298817753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:08:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3b5e4d32-5596-4b7a-ac50-ece0f8967abb tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:53 devstack sudo[98429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18 1G
Sep 25 15:08:53 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:54 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3b5e4d32-5596-4b7a-ac50-ece0f8967abb tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18 1G" returned: 0 in 0.703s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3b5e4d32-5596-4b7a-ac50-ece0f8967abb tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:54 devstack sudo[98435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18
Sep 25 15:08:54 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Acquiring lock "cinder-quobyte-856e6abb-089f-4eb8-b577-6cf41942070e" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Lock "cinder-quobyte-856e6abb-089f-4eb8-b577-6cf41942070e" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:54 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f50351b-9963-4a28-98d9-9ebd4229a50d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856e6abb-089f-4eb8-b577-6cf41942070e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:54 devstack sudo[98440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856e6abb-089f-4eb8-b577-6cf41942070e
Sep 25 15:08:54 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:54 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3b5e4d32-5596-4b7a-ac50-ece0f8967abb tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18" returned: 0 in 0.383s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:54 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-3b5e4d32-5596-4b7a-ac50-ece0f8967abb tempest-SnapshotsActionsTest-1298817753 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18 is being set with open permissions: ugo+rw
Sep 25 15:08:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3b5e4d32-5596-4b7a-ac50-ece0f8967abb tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:54 devstack sudo[98449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18
Sep 25 15:08:54 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:54 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856e6abb-089f-4eb8-b577-6cf41942070e" returned: 0 in 0.560s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856e6abb-089f-4eb8-b577-6cf41942070e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:54 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3b5e4d32-5596-4b7a-ac50-ece0f8967abb tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18" returned: 0 in 0.358s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:55 devstack sudo[98455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856e6abb-089f-4eb8-b577-6cf41942070e
Sep 25 15:08:55 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3b5e4d32-5596-4b7a-ac50-ece0f8967abb tempest-SnapshotsActionsTest-1298817753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.680s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] Creating offline snapshot 6b07ff66-574b-4459-8bfb-0e06004936c0 of volume d540b826-74bb-43b8-ac59-b23747d42f42 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:08:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3b5e4d32-5596-4b7a-ac50-ece0f8967abb tempest-SnapshotsActionsTest-1298817753 None] Create snapshot completed successfully
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[318acd52-b67a-41cc-bfb9-72428708fbc1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:55 devstack sudo[98457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42
Sep 25 15:08:55 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:55 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856e6abb-089f-4eb8-b577-6cf41942070e" returned: 0 in 0.362s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Lock "cinder-quobyte-856e6abb-089f-4eb8-b577-6cf41942070e" released by "delete_volume" :: held 1.022s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Created reservations ['f5f45bde-d722-482b-bfe8-843bc69e4cfc'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:08:55 devstack cinder-volume[87071]: WARNING cinder.quota [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-759895091 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-759895091, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:08:55 devstack cinder-volume[87071]: WARNING cinder.quota [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-759895091 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-759895091, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Created reservations ['644b22e2-21b2-4c6e-b42b-d66235ec89a2', 'd342444f-8b74-4460-8254-8ae774615f49', '0f01e9d7-fe39-4e8a-ac36-44c4894017f3', '0a3dd68b-6f12-4503-9c69-8ee9edb55819'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:55 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42" returned: 0 in 0.774s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:55 devstack sudo[98464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0 1G
Sep 25 15:08:55 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:55 devstack sudo[98463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:08:55 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:56 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Acquiring lock "cinder-1407d373-d0ba-4083-9279-c568f8221c18-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.571s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:56 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:08:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-473b61d8-995e-4423-9037-3726de2a908b tempest-GroupsV314Test-423311671 None] Delete group completed successfully.
Sep 25 15:08:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-1407d373-d0ba-4083-9279-c568f8221c18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Acquiring lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Acquiring lock "cinder-quobyte-1407d373-d0ba-4083-9279-c568f8221c18" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-quobyte-1407d373-d0ba-4083-9279-c568f8221c18" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Deleting offline snapshot 1407d373-d0ba-4083-9279-c568f8221c18 of volume 0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:08:56 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] snapshot_file for this snap is: volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:08:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0 1G" returned: 0 in 0.682s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d540b826-74bb-43b8-ac59-b23747d42f42 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:56 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d57b5b6-2eb7-4c07-8c1e-68dff7461e07]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:56 devstack sudo[98472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d540b826-74bb-43b8-ac59-b23747d42f42 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0
Sep 25 15:08:56 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:56 devstack sudo[98473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18
Sep 25 15:08:56 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:56 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d540b826-74bb-43b8-ac59-b23747d42f42 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0" returned: 0 in 0.389s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:56 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0 is being set with open permissions: ugo+rw
Sep 25 15:08:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:57 devstack sudo[98480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0
Sep 25 15:08:57 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:57 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18" returned: 0 in 0.570s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:08:57 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e110bad2-f29e-431d-8b36-9db6e48efa4c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:57 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0" returned: 0 in 0.391s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:57 devstack sudo[98486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361
Sep 25 15:08:57 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:57 devstack sudo[98490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.info
Sep 25 15:08:57 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] Acquiring lock "cinder-quobyte-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:08:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] Lock "cinder-quobyte-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:08:57 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5560ad6c-6986-4fec-aeec-b94266dc1924]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:08:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:57 devstack sudo[98506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3
Sep 25 15:08:57 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:57 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361" returned: 0 in 0.744s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:08:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:57 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.info" returned: 0 in 0.577s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:58 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.info is being set with open permissions: ugo+rw
Sep 25 15:08:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:58 devstack sudo[98532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18
Sep 25 15:08:58 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:58 devstack sudo[98533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.info
Sep 25 15:08:58 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:58 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3" returned: 0 in 0.640s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:58 devstack sudo[98541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3
Sep 25 15:08:58 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:58 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.info" returned: 0 in 0.440s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.427s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:58 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c7225515-6646-41e5-afd4-b3bfb965229a tempest-VolumesSnapshotTestJSON-698939427 None] Create snapshot completed successfully
Sep 25 15:08:58 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18" returned: 0 in 0.798s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:58 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3" returned: 0 in 0.444s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:58 devstack sudo[98549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18
Sep 25 15:08:58 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] Lock "cinder-quobyte-4fc0fc7c-a5d6-4f77-9ae1-eff266ca17b3" released by "delete_volume" :: held 1.233s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:58 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] Created reservations ['8d4b6562-7d39-4b5d-b5dd-f795fbaaec81'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:08:59 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] Created reservations ['c8f616b6-e747-417f-b338-b86e01dcee29', '8fdc4d55-f94a-496b-9136-b4d307e8899c', '0c74d90f-9552-4a2d-8e79-07fd669af9ec', 'fd6e586b-38c5-47d1-a114-3f8749ca8e65'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:08:59 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.1407d373-d0ba-4083-9279-c568f8221c18" returned: 0 in 0.463s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:08:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:08:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:08:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:08:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:08:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:08:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-quobyte-1407d373-d0ba-4083-9279-c568f8221c18" released by "_delete_snapshot" :: held 2.765s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" released by "delete_snapshot" :: held 2.812s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:59 devstack sudo[98552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:08:59 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:08:59 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Created reservations ['04329814-f34e-485a-9034-14ee893b9ccc', 'f1d44f9f-a3ff-4b9e-85fc-07deeb6f92e5', 'a750e42b-c992-4451-b650-08e29f18b8c5', '4ef4f53b-0246-4a2e-a80d-917b43bbc85a'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:08:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Delete snapshot completed successfully.
Sep 25 15:08:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4c362cf7-12ae-4b7e-9f82-a4824381189a tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-1407d373-d0ba-4083-9279-c568f8221c18-delete_snapshot" released by "delete_snapshot" :: held 3.078s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:08:59 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root
Sep 25 15:08:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.459s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:08:59 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:08:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e3149326-4bd4-4f15-898f-922cde5c7c7d tempest-GroupsV314Test-423311671 None] Delete group completed successfully.
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-be101170-69ee-4ecc-a645-9255bde347a6 tempest-SnapshotsActionsTest-1298817753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-be101170-69ee-4ecc-a645-9255bde347a6 tempest-SnapshotsActionsTest-1298817753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-be101170-69ee-4ecc-a645-9255bde347a6 tempest-SnapshotsActionsTest-1298817753 None] Creating offline snapshot 7d076481-9065-45d5-9c9a-ef38e805bcd4 of volume 0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ec0bee-ad59-4f6d-a81f-02cb7d06b168]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-be101170-69ee-4ecc-a645-9255bde347a6 tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:00 devstack sudo[98555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361
Sep 25 15:09:00 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Flow 'volume_create_manager' (cc69f91f-25a9-415f-afac-d323c1038b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739d47e1-acb5-40d4-abc7-551ea12762cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739d47e1-acb5-40d4-abc7-551ea12762cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1662803256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6a2df3-1ba7-40cd-a9dd-00645d70e266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8344c06e0c8b4bce89e92bae73929d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:09:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6b07ff66-574b-4459-8bfb-0e06004936c0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:09:01Z,use_quota=True,user_id='9a7d3786e7154231a065362de14b35e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7302420b-dba6-434e-9d93-8773d572a03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7302420b-dba6-434e-9d93-8773d572a03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cbba5f-18c5-4255-9049-cb73a70ebbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cbba5f-18c5-4255-9049-cb73a70ebbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4e6a2df3-1ba7-40cd-a9dd-00645d70e266', 'volume_name': 'volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266', 'volume_size': 2, 'snapshot_id': '6b07ff66-574b-4459-8bfb-0e06004936c0'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f154a026-9880-4d13-9298-66c72f864614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f154a026-9880-4d13-9298-66c72f864614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9d21a4-536c-4b95-ab1c-fbd4d27e76ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:00 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Volume 4e6a2df3-1ba7-40cd-a9dd-00645d70e266: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266', 'volume_size': 2, 'snapshot_id': '6b07ff66-574b-4459-8bfb-0e06004936c0'}
Sep 25 15:09:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:01 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-be101170-69ee-4ecc-a645-9255bde347a6 tempest-SnapshotsActionsTest-1298817753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361" returned: 0 in 0.724s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-be101170-69ee-4ecc-a645-9255bde347a6 tempest-SnapshotsActionsTest-1298817753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:09:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-be101170-69ee-4ecc-a645-9255bde347a6 tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:01 devstack sudo[98563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4 1G
Sep 25 15:09:01 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:01 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-be101170-69ee-4ecc-a645-9255bde347a6 tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4 1G" returned: 0 in 0.679s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-be101170-69ee-4ecc-a645-9255bde347a6 tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:01 devstack sudo[98570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4
Sep 25 15:09:01 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:02 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-be101170-69ee-4ecc-a645-9255bde347a6 tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4" returned: 0 in 0.464s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:02 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-be101170-69ee-4ecc-a645-9255bde347a6 tempest-SnapshotsActionsTest-1298817753 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4 is being set with open permissions: ugo+rw
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-be101170-69ee-4ecc-a645-9255bde347a6 tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:02 devstack sudo[98576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4
Sep 25 15:09:02 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:02 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-be101170-69ee-4ecc-a645-9255bde347a6 tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4" returned: 0 in 0.503s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-be101170-69ee-4ecc-a645-9255bde347a6 tempest-SnapshotsActionsTest-1298817753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.992s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-quobyte-6b07ff66-574b-4459-8bfb-0e06004936c0-4e6a2df3-1ba7-40cd-a9dd-00645d70e266" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-6b07ff66-574b-4459-8bfb-0e06004936c0-4e6a2df3-1ba7-40cd-a9dd-00645d70e266" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Creating volume 4e6a2df3-1ba7-40cd-a9dd-00645d70e266 from snapshot 6b07ff66-574b-4459-8bfb-0e06004936c0 {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-quobyte-4e6a2df3-1ba7-40cd-a9dd-00645d70e266" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:02 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-be101170-69ee-4ecc-a645-9255bde347a6 tempest-SnapshotsActionsTest-1298817753 None] Create snapshot completed successfully
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-4e6a2df3-1ba7-40cd-a9dd-00645d70e266" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] snapshot: 6b07ff66-574b-4459-8bfb-0e06004936c0, volume: 4e6a2df3-1ba7-40cd-a9dd-00645d70e266,  {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fc3b33-30be-40d4-8bd4-18cd85236a97]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:03 devstack sudo[98579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0
Sep 25 15:09:03 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:03 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0" returned: 0 in 0.664s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d540b826-74bb-43b8-ac59-b23747d42f42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Acquiring lock "cinder-7d076481-9065-45d5-9c9a-ef38e805bcd4-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd6bc6d-03ca-42f9-8a08-4279dd7b9bf5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-7d076481-9065-45d5-9c9a-ef38e805bcd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Acquiring lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Acquiring lock "cinder-quobyte-7d076481-9065-45d5-9c9a-ef38e805bcd4" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-quobyte-7d076481-9065-45d5-9c9a-ef38e805bcd4" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Deleting offline snapshot 7d076481-9065-45d5-9c9a-ef38e805bcd4 of volume 0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:09:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] snapshot_file for this snap is: volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:09:03 devstack sudo[98584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42
Sep 25 15:09:03 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:04 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cabc58-4be3-46d0-a70f-95fa30df3988]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:04 devstack sudo[98587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4
Sep 25 15:09:04 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:04 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42" returned: 0 in 0.650s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 15:09:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 15:09:04 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Path /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266 not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 15:09:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:04 devstack sudo[98593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266
Sep 25 15:09:04 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:04 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4" returned: 0 in 0.749s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:09:04 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e4cde4-ec03-46c8-84f5-4c79cba71e36]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:05 devstack sudo[98600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361
Sep 25 15:09:05 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:05 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361" returned: 0 in 0.735s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:09:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:05 devstack sudo[98613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4
Sep 25 15:09:05 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:06 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:09:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Flow 'volume_create_manager' (0b0f10b6-a3be-4e9b-8e3e-63babf8bc1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:09:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2719900-d392-4348-b222-cf6306431cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:06 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4" returned: 0 in 1.370s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:06 devstack sudo[98620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4
Sep 25 15:09:06 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2719900-d392-4348-b222-cf6306431cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1611599768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8438668e-9386-4d2c-a47f-98ce96860ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec209cad0db74272a9cdb1cd5ac2cf6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:09:07Z,use_quota=True,user_id='fe33fc10371a45758280d107f1b1e9e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d257652-bd58-4677-94bb-ad2435055809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d257652-bd58-4677-94bb-ad2435055809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4dbd07b-ae76-4181-b356-4d4792fbd92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4dbd07b-ae76-4181-b356-4d4792fbd92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8438668e-9386-4d2c-a47f-98ce96860ad9', 'volume_name': 'volume-8438668e-9386-4d2c-a47f-98ce96860ad9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5123946f-415e-4a5f-b8c7-dbfd68bb2486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5123946f-415e-4a5f-b8c7-dbfd68bb2486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29f0388-af6c-492f-b6a8-76a3e8c569ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:07 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Volume 8438668e-9386-4d2c-a47f-98ce96860ad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8438668e-9386-4d2c-a47f-98ce96860ad9', 'volume_size': 1}
Sep 25 15:09:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:07 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.7d076481-9065-45d5-9c9a-ef38e805bcd4" returned: 0 in 0.938s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-quobyte-7d076481-9065-45d5-9c9a-ef38e805bcd4" released by "_delete_snapshot" :: held 4.135s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" released by "delete_snapshot" :: held 4.184s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:08 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:09:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Flow 'volume_create_manager' (19b8162c-1572-420e-ace4-62248bc447ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:09:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4d3faa-777a-4538-a054-3c1f94bd0a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4d3faa-777a-4538-a054-3c1f94bd0a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-228270206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d768c3b-111c-4bb4-b1a7-c88a26db31ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec209cad0db74272a9cdb1cd5ac2cf6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:09:08Z,use_quota=True,user_id='fe33fc10371a45758280d107f1b1e9e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb6f70f-d32b-4d79-85f2-c2970bf0f4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb6f70f-d32b-4d79-85f2-c2970bf0f4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66632baa-2b89-4a59-affc-129f99196112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66632baa-2b89-4a59-affc-129f99196112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d768c3b-111c-4bb4-b1a7-c88a26db31ad', 'volume_name': 'volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968c6ae0-25fc-4870-ab92-46cec15a7e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968c6ae0-25fc-4870-ab92-46cec15a7e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e88aec5-a356-4c03-ab2c-99facde9927d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:08 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Volume 9d768c3b-111c-4bb4-b1a7-c88a26db31ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad', 'volume_size': 1}
Sep 25 15:09:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:08 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Created reservations ['98f76a23-ee5b-4510-9c7d-297628c69b0c', '4a859155-2f7b-47d5-b0c1-98319cdd66ec', '49bd34ef-196f-4bb0-ad8d-f7e063a9710c', '02f5e13c-c55f-4333-bcfd-36cceee103b0'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:09:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Delete snapshot completed successfully.
Sep 25 15:09:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b019f52-7d56-4318-9cb4-86fe602fdf46 tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-7d076481-9065-45d5-9c9a-ef38e805bcd4-delete_snapshot" released by "delete_snapshot" :: held 5.002s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8a9f296b-03b1-4bd9-9b09-0c6141be0605 tempest-SnapshotsActionsTest-1298817753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:14 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266" returned: 0 in 10.381s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:14 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Image conversion details: src /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42, size 1024.00 MB, duration 10.38 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:09:14 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Converted 1024.00 MB image at 98.63 MB/s
Sep 25 15:09:14 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266 is being set with open permissions: ugo+rw
Sep 25 15:09:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:14 devstack sudo[98624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266
Sep 25 15:09:14 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:15 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266" returned: 0 in 0.331s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-4e6a2df3-1ba7-40cd-a9dd-00645d70e266" released by "_copy_volume_from_snapshot" :: held 12.185s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-6b07ff66-574b-4459-8bfb-0e06004936c0-4e6a2df3-1ba7-40cd-a9dd-00645d70e266" released by "_create_volume_from_snapshot" :: held 12.307s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.353s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.990s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1611599768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8438668e-9386-4d2c-a47f-98ce96860ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec209cad0db74272a9cdb1cd5ac2cf6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:09:07Z,use_quota=True,user_id='fe33fc10371a45758280d107f1b1e9e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Creating volume 8438668e-9386-4d2c-a47f-98ce96860ad9 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:09:15 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8438668e-9386-4d2c-a47f-98ce96860ad9 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:15 devstack sudo[98627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8438668e-9386-4d2c-a47f-98ce96860ad9 1073741824
Sep 25 15:09:15 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9d21a4-536c-4b95-ab1c-fbd4d27e76ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266', 'volume_size': 2, 'snapshot_id': '6b07ff66-574b-4459-8bfb-0e06004936c0'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40891bbc-b5aa-4ff4-840c-67dc500537d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Volume volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266 (4e6a2df3-1ba7-40cd-a9dd-00645d70e266): created successfully
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40891bbc-b5aa-4ff4-840c-67dc500537d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Flow 'volume_create_manager' (cc69f91f-25a9-415f-afac-d323c1038b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:09:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-32e17baf-18db-4811-94c3-b6d0e2377fa0 tempest-VolumesSnapshotTestJSON-698939427 None] Created volume successfully.
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-4e6a2df3-1ba7-40cd-a9dd-00645d70e266-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-4e6a2df3-1ba7-40cd-a9dd-00645d70e266-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-quobyte-4e6a2df3-1ba7-40cd-a9dd-00645d70e266" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-4e6a2df3-1ba7-40cd-a9dd-00645d70e266" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:16 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8438668e-9386-4d2c-a47f-98ce96860ad9 1073741824" returned: 0 in 0.875s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac237d84-e5cd-4d46-8046-85f6e5009dea]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8438668e-9386-4d2c-a47f-98ce96860ad9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:16 devstack sudo[98637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8438668e-9386-4d2c-a47f-98ce96860ad9
Sep 25 15:09:16 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Flow 'volume_create_manager' (e6cd021b-31f6-4064-98a0-c40e44e5bbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022be065-5d43-4927-8dfc-338367ca3d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:16 devstack sudo[98636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266
Sep 25 15:09:16 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022be065-5d43-4927-8dfc-338367ca3d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1737140938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182f81eb-73c9-4f57-baf0-99bacf30f4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72596e02cc845b7bc86311c59b16128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:09:16Z,use_quota=True,user_id='54644967dce44552b0dd89856e9d265a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3339628-7e12-4ee4-8c42-0d3f99e3e99b),volume_type_id=e3339628-7e12-4ee4-8c42-0d3f99e3e99b)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510b6339-2152-49b3-aded-d669e3c96820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510b6339-2152-49b3-aded-d669e3c96820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e0b8a8-4cf3-4ef8-9087-68ad4dfa14e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e0b8a8-4cf3-4ef8-9087-68ad4dfa14e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '182f81eb-73c9-4f57-baf0-99bacf30f4fc', 'volume_name': 'volume-182f81eb-73c9-4f57-baf0-99bacf30f4fc', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fdb4a7-e100-4cac-a53b-7b0d1ccaa1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fdb4a7-e100-4cac-a53b-7b0d1ccaa1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704d319f-7bcd-4d1b-a9ae-d460b364afee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Volume 182f81eb-73c9-4f57-baf0-99bacf30f4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-182f81eb-73c9-4f57-baf0-99bacf30f4fc', 'volume_size': 1}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:16 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8438668e-9386-4d2c-a47f-98ce96860ad9" returned: 0 in 0.402s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.051s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-228270206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d768c3b-111c-4bb4-b1a7-c88a26db31ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec209cad0db74272a9cdb1cd5ac2cf6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:09:08Z,use_quota=True,user_id='fe33fc10371a45758280d107f1b1e9e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Creating volume 9d768c3b-111c-4bb4-b1a7-c88a26db31ad {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:09:16 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:16 devstack sudo[98644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad 1073741824
Sep 25 15:09:16 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29f0388-af6c-492f-b6a8-76a3e8c569ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8438668e-9386-4d2c-a47f-98ce96860ad9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:16 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621161ee-0838-4f73-86fe-a065332d6b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266" returned: 0 in 0.514s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Volume volume-8438668e-9386-4d2c-a47f-98ce96860ad9 (8438668e-9386-4d2c-a47f-98ce96860ad9): created successfully
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621161ee-0838-4f73-86fe-a065332d6b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:16 devstack sudo[98646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266
Sep 25 15:09:16 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Flow 'volume_create_manager' (0b0f10b6-a3be-4e9b-8e3e-63babf8bc1e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:09:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3d308866-9b33-44e0-a120-aed648a3d445 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Created volume successfully.
Sep 25 15:09:17 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4e6a2df3-1ba7-40cd-a9dd-00645d70e266" returned: 0 in 0.432s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-4e6a2df3-1ba7-40cd-a9dd-00645d70e266" released by "delete_volume" :: held 1.025s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Created reservations ['616b5d83-61e1-4c26-be14-761c9b8d51f2', '1f0a06a2-6232-489c-aac1-01400fe7d7ac', 'a3a5470b-a581-40cb-816e-f1f33b7d0692', 'aafae623-38a4-44a3-bf5c-1773c9fb17c1'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:17 devstack sudo[98654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:09:17 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:17 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad 1073741824" returned: 0 in 0.827s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:17 devstack sudo[98656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad
Sep 25 15:09:17 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:17 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.343s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:09:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Deleted volume successfully.
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ecbb17d-f730-4947-9114-986623098561 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-4e6a2df3-1ba7-40cd-a9dd-00645d70e266-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:17 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad" returned: 0 in 0.340s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8a9f296b-03b1-4bd9-9b09-0c6141be0605 tempest-SnapshotsActionsTest-1298817753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.417s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e88aec5-a356-4c03-ab2c-99facde9927d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a202823-ba85-4b79-a9fa-a5c2739d1ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8a9f296b-03b1-4bd9-9b09-0c6141be0605 tempest-SnapshotsActionsTest-1298817753 None] Creating offline snapshot 6a53cbf4-d36f-48e5-908c-45b3cec82d14 of volume 0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:09:17 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Volume volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad (9d768c3b-111c-4bb4-b1a7-c88a26db31ad): created successfully
Sep 25 15:09:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a202823-ba85-4b79-a9fa-a5c2739d1ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Flow 'volume_create_manager' (19b8162c-1572-420e-ace4-62248bc447ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:09:18 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1575b6ad-c86f-400f-9f1a-613317d47754]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8a9f296b-03b1-4bd9-9b09-0c6141be0605 tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-36f33653-e420-462f-8e0a-e8cceced2893 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Created volume successfully.
Sep 25 15:09:18 devstack sudo[98660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361
Sep 25 15:09:18 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-6b07ff66-574b-4459-8bfb-0e06004936c0-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-6b07ff66-574b-4459-8bfb-0e06004936c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-quobyte-d540b826-74bb-43b8-ac59-b23747d42f42" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-d540b826-74bb-43b8-ac59-b23747d42f42" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-quobyte-6b07ff66-574b-4459-8bfb-0e06004936c0" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-6b07ff66-574b-4459-8bfb-0e06004936c0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Deleting offline snapshot 6b07ff66-574b-4459-8bfb-0e06004936c0 of volume d540b826-74bb-43b8-ac59-b23747d42f42 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:09:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] snapshot_file for this snap is: volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:09:18 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8a9f296b-03b1-4bd9-9b09-0c6141be0605 tempest-SnapshotsActionsTest-1298817753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361" returned: 0 in 0.545s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8a9f296b-03b1-4bd9-9b09-0c6141be0605 tempest-SnapshotsActionsTest-1298817753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:09:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8a9f296b-03b1-4bd9-9b09-0c6141be0605 tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:18 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfee3b9-0311-428e-8977-e1dc910c69e9]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:18 devstack sudo[98669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14 1G
Sep 25 15:09:18 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:18 devstack sudo[98672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0
Sep 25 15:09:18 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:19 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0" returned: 0 in 0.561s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d540b826-74bb-43b8-ac59-b23747d42f42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:09:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b58a02c-61e3-4f6a-8788-800b314b578c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:19 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8a9f296b-03b1-4bd9-9b09-0c6141be0605 tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14 1G" returned: 0 in 0.791s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8a9f296b-03b1-4bd9-9b09-0c6141be0605 tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:19 devstack sudo[98693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42
Sep 25 15:09:19 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:19 devstack sudo[98694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14
Sep 25 15:09:19 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:19 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8a9f296b-03b1-4bd9-9b09-0c6141be0605 tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14" returned: 0 in 0.365s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:19 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-8a9f296b-03b1-4bd9-9b09-0c6141be0605 tempest-SnapshotsActionsTest-1298817753 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14 is being set with open permissions: ugo+rw
Sep 25 15:09:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8a9f296b-03b1-4bd9-9b09-0c6141be0605 tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:19 devstack sudo[98703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14
Sep 25 15:09:19 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:19 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42" returned: 0 in 0.676s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:19 devstack sudo[98706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0
Sep 25 15:09:19 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:20 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8a9f296b-03b1-4bd9-9b09-0c6141be0605 tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14" returned: 0 in 0.307s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8a9f296b-03b1-4bd9-9b09-0c6141be0605 tempest-SnapshotsActionsTest-1298817753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.731s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1737140938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182f81eb-73c9-4f57-baf0-99bacf30f4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72596e02cc845b7bc86311c59b16128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:09:16Z,use_quota=True,user_id='54644967dce44552b0dd89856e9d265a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3339628-7e12-4ee4-8c42-0d3f99e3e99b),volume_type_id=e3339628-7e12-4ee4-8c42-0d3f99e3e99b)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Creating volume 182f81eb-73c9-4f57-baf0-99bacf30f4fc {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:09:20 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-182f81eb-73c9-4f57-baf0-99bacf30f4fc 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:20 devstack sudo[98709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-182f81eb-73c9-4f57-baf0-99bacf30f4fc 1073741824
Sep 25 15:09:20 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:20 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8a9f296b-03b1-4bd9-9b09-0c6141be0605 tempest-SnapshotsActionsTest-1298817753 None] Create snapshot completed successfully
Sep 25 15:09:20 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0" returned: 0 in 0.579s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:20 devstack sudo[98718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0
Sep 25 15:09:20 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:20 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-182f81eb-73c9-4f57-baf0-99bacf30f4fc 1073741824" returned: 0 in 0.651s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-182f81eb-73c9-4f57-baf0-99bacf30f4fc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:20 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:20 devstack sudo[98722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-182f81eb-73c9-4f57-baf0-99bacf30f4fc
Sep 25 15:09:20 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42.6b07ff66-574b-4459-8bfb-0e06004936c0" returned: 0 in 0.383s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:20 devstack sudo[98724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:09:20 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-6b07ff66-574b-4459-8bfb-0e06004936c0" released by "_delete_snapshot" :: held 2.408s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-d540b826-74bb-43b8-ac59-b23747d42f42" released by "delete_snapshot" :: held 2.445s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Created reservations ['c03dede8-5a00-44d5-8c68-8a995e941c14', '550a1e5f-9833-4c63-b9f3-be9fd4a14790', 'c068bb23-35c2-49b9-9e6c-c3e1fda36e4a', '349a146f-1b1e-432e-a575-86ad43715de6'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:09:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Delete snapshot completed successfully.
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-34bac504-12f0-4dfc-a74b-e6d952b6623d tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-6b07ff66-574b-4459-8bfb-0e06004936c0-delete_snapshot" released by "delete_snapshot" :: held 2.714s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:21 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-182f81eb-73c9-4f57-baf0-99bacf30f4fc" returned: 0 in 0.410s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704d319f-7bcd-4d1b-a9ae-d460b364afee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182f81eb-73c9-4f57-baf0-99bacf30f4fc', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8739b2-e8ff-4d9e-ad9a-7c0acfe4d032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:21 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Volume volume-182f81eb-73c9-4f57-baf0-99bacf30f4fc (182f81eb-73c9-4f57-baf0-99bacf30f4fc): created successfully
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8739b2-e8ff-4d9e-ad9a-7c0acfe4d032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Flow 'volume_create_manager' (e6cd021b-31f6-4064-98a0-c40e44e5bbbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:09:21 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.474s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:09:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3aa7add4-021a-42eb-8b7a-36e3f2df4707 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Created volume successfully.
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Acquiring lock "cinder-6a53cbf4-d36f-48e5-908c-45b3cec82d14-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-6a53cbf4-d36f-48e5-908c-45b3cec82d14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Acquiring lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Acquiring lock "cinder-quobyte-6a53cbf4-d36f-48e5-908c-45b3cec82d14" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-quobyte-6a53cbf4-d36f-48e5-908c-45b3cec82d14" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Deleting offline snapshot 6a53cbf4-d36f-48e5-908c-45b3cec82d14 of volume 0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] snapshot_file for this snap is: volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efe555d-8a80-4fe1-9a0d-c9e63e9ddf89]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:21 devstack sudo[98729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14
Sep 25 15:09:21 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-d540b826-74bb-43b8-ac59-b23747d42f42-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-d540b826-74bb-43b8-ac59-b23747d42f42-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-quobyte-d540b826-74bb-43b8-ac59-b23747d42f42" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-d540b826-74bb-43b8-ac59-b23747d42f42" acquired by "delete_volume" :: waited 0.044s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:22 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f499f9-7f93-433a-a36e-7b6ca07e5f54]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:22 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14" returned: 0 in 0.889s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:09:22 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0430f877-133c-48ec-a493-8df167868afe]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:22 devstack sudo[98746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42
Sep 25 15:09:22 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:22 devstack sudo[98750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361
Sep 25 15:09:22 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bd39d3f9-60c5-46ee-91b9-2c8de6aedcd4 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bd39d3f9-60c5-46ee-91b9-2c8de6aedcd4 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bd39d3f9-60c5-46ee-91b9-2c8de6aedcd4 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bd39d3f9-60c5-46ee-91b9-2c8de6aedcd4 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bd39d3f9-60c5-46ee-91b9-2c8de6aedcd4 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bd39d3f9-60c5-46ee-91b9-2c8de6aedcd4 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:22 devstack sudo[98771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:09:22 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:23 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42" returned: 0 in 0.987s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:23 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bd39d3f9-60c5-46ee-91b9-2c8de6aedcd4 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.524s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:23 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bd39d3f9-60c5-46ee-91b9-2c8de6aedcd4 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:09:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-bd39d3f9-60c5-46ee-91b9-2c8de6aedcd4 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Retype volume completed successfully.
Sep 25 15:09:23 devstack sudo[98794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42
Sep 25 15:09:23 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:23 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361" returned: 0 in 0.945s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:09:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:23 devstack sudo[98799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14
Sep 25 15:09:23 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:23 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d540b826-74bb-43b8-ac59-b23747d42f42" returned: 0 in 0.601s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-d540b826-74bb-43b8-ac59-b23747d42f42" released by "delete_volume" :: held 1.855s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Created reservations ['789d0ea3-0138-4353-bb39-f111fb99395c', '47c51c58-d90f-43cf-a5c9-027023c397b3', 'cba46548-9cfd-4619-a4e2-5ec5f5e336ef', 'c3cc99d2-4760-4069-b1d9-4158f7b1f9a8'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Acquiring lock "cinder-182f81eb-73c9-4f57-baf0-99bacf30f4fc-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:24 devstack sudo[98822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:09:24 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Lock "cinder-182f81eb-73c9-4f57-baf0-99bacf30f4fc-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:24 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14" returned: 0 in 1.003s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:24 devstack sudo[98825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14
Sep 25 15:09:24 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Acquiring lock "cinder-quobyte-182f81eb-73c9-4f57-baf0-99bacf30f4fc" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Lock "cinder-quobyte-182f81eb-73c9-4f57-baf0-99bacf30f4fc" acquired by "delete_volume" :: waited 0.041s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[835d3a41-194a-4681-8e17-8020c0380b3b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-182f81eb-73c9-4f57-baf0-99bacf30f4fc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:24 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:24 devstack sudo[98831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-182f81eb-73c9-4f57-baf0-99bacf30f4fc
Sep 25 15:09:24 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.552s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:09:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Deleted volume successfully.
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-24a4a568-fd86-4366-a274-72b494d594ec tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-d540b826-74bb-43b8-ac59-b23747d42f42-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:24 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.6a53cbf4-d36f-48e5-908c-45b3cec82d14" returned: 0 in 0.461s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-quobyte-6a53cbf4-d36f-48e5-908c-45b3cec82d14" released by "_delete_snapshot" :: held 3.506s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" released by "delete_snapshot" :: held 3.536s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Created reservations ['672fc039-3614-45b5-926f-dce2c56639e3', 'e19f67ff-bef0-4e10-87af-951a68bbb11f', 'f44aba43-c147-4607-b98f-77ad7108538b', '589c22b1-e256-4dcc-b099-a18537866419'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:09:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Delete snapshot completed successfully.
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3128b0ad-4cbc-4379-a4e2-2f6a47608e1a tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-6a53cbf4-d36f-48e5-908c-45b3cec82d14-delete_snapshot" released by "delete_snapshot" :: held 3.851s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:25 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-182f81eb-73c9-4f57-baf0-99bacf30f4fc" returned: 0 in 0.725s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-182f81eb-73c9-4f57-baf0-99bacf30f4fc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:25 devstack sudo[98848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-182f81eb-73c9-4f57-baf0-99bacf30f4fc
Sep 25 15:09:25 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Flow 'volume_create_manager' (60dec1c2-852d-4d28-a392-d6f836365f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ac90d0-017f-46c5-8f87-8291b61d3d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ac90d0-017f-46c5-8f87-8291b61d3d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1883522611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c864f7-7241-4b9a-886f-c7fe229c6300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8344c06e0c8b4bce89e92bae73929d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:09:25Z,use_quota=True,user_id='9a7d3786e7154231a065362de14b35e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8bd6a4-3637-4512-9325-c272d54e487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8bd6a4-3637-4512-9325-c272d54e487e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b77fcf8-d2d1-4e65-ae27-b561235f4362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b77fcf8-d2d1-4e65-ae27-b561235f4362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82c864f7-7241-4b9a-886f-c7fe229c6300', 'volume_name': 'volume-82c864f7-7241-4b9a-886f-c7fe229c6300', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c8d3b3-90f6-4cf1-bbc3-4a439a30a69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c8d3b3-90f6-4cf1-bbc3-4a439a30a69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f85b51-f696-4889-a241-870a873e3d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:25 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Volume 82c864f7-7241-4b9a-886f-c7fe229c6300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82c864f7-7241-4b9a-886f-c7fe229c6300', 'volume_size': 1}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1883522611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c864f7-7241-4b9a-886f-c7fe229c6300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8344c06e0c8b4bce89e92bae73929d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:09:25Z,use_quota=True,user_id='9a7d3786e7154231a065362de14b35e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Creating volume 82c864f7-7241-4b9a-886f-c7fe229c6300 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:09:25 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:25 devstack sudo[98850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300 1073741824
Sep 25 15:09:25 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:25 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-182f81eb-73c9-4f57-baf0-99bacf30f4fc" returned: 0 in 0.535s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Lock "cinder-quobyte-182f81eb-73c9-4f57-baf0-99bacf30f4fc" released by "delete_volume" :: held 1.355s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:25 devstack cinder-volume[87071]: WARNING cinder.quota [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:09:25 devstack cinder-volume[87071]: WARNING cinder.quota [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:09:25 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Created reservations ['04d58b89-cf25-443b-9b99-08c84d09af5b', '2caa8d68-7e43-4213-94d4-37b8140ef451', '42b00779-b9e3-442d-8f48-30112e51edcc', '757d5fd6-6146-484f-aa47-692a9c0aa9b9'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:09:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:26 devstack sudo[98857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:09:26 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b95e6d82-ebce-4b39-a8e8-1a072a00dade tempest-SnapshotsActionsTest-1298817753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:26 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300 1073741824" returned: 0 in 0.976s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:26 devstack sudo[98861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300
Sep 25 15:09:26 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:26 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.656s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:26 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:09:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Deleted volume successfully.
Sep 25 15:09:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2ec0b23a-421c-4492-af45-5be68ac7b237 tempest-VolumeRetypeWithoutMigrationTest-2133045451 None] Lock "cinder-182f81eb-73c9-4f57-baf0-99bacf30f4fc-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:27 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300" returned: 0 in 0.469s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:09:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b95e6d82-ebce-4b39-a8e8-1a072a00dade tempest-SnapshotsActionsTest-1298817753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.711s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f85b51-f696-4889-a241-870a873e3d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82c864f7-7241-4b9a-886f-c7fe229c6300', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b612993f-c330-4ade-8b95-d75939bcb269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b95e6d82-ebce-4b39-a8e8-1a072a00dade tempest-SnapshotsActionsTest-1298817753 None] Creating offline snapshot 4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f of volume 0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:09:27 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Volume volume-82c864f7-7241-4b9a-886f-c7fe229c6300 (82c864f7-7241-4b9a-886f-c7fe229c6300): created successfully
Sep 25 15:09:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b612993f-c330-4ade-8b95-d75939bcb269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Flow 'volume_create_manager' (60dec1c2-852d-4d28-a392-d6f836365f40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:09:27 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b95be4-1e4d-4e43-a81f-ed85abe9c35c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b95e6d82-ebce-4b39-a8e8-1a072a00dade tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4a9fcd97-f0dc-452a-8ed1-2a31cc13fdca tempest-VolumesSnapshotTestJSON-698939427 None] Created volume successfully.
Sep 25 15:09:27 devstack sudo[98865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361
Sep 25 15:09:27 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:28 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b95e6d82-ebce-4b39-a8e8-1a072a00dade tempest-SnapshotsActionsTest-1298817753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361" returned: 0 in 0.774s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b95e6d82-ebce-4b39-a8e8-1a072a00dade tempest-SnapshotsActionsTest-1298817753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:09:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b95e6d82-ebce-4b39-a8e8-1a072a00dade tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:28 devstack sudo[98871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f 1G
Sep 25 15:09:28 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:28 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b95e6d82-ebce-4b39-a8e8-1a072a00dade tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f 1G" returned: 0 in 0.915s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b95e6d82-ebce-4b39-a8e8-1a072a00dade tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:29 devstack sudo[98877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f
Sep 25 15:09:29 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:29 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b95e6d82-ebce-4b39-a8e8-1a072a00dade tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f" returned: 0 in 0.564s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:29 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-b95e6d82-ebce-4b39-a8e8-1a072a00dade tempest-SnapshotsActionsTest-1298817753 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f is being set with open permissions: ugo+rw
Sep 25 15:09:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b95e6d82-ebce-4b39-a8e8-1a072a00dade tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:29 devstack sudo[98884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f
Sep 25 15:09:29 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:29 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b95e6d82-ebce-4b39-a8e8-1a072a00dade tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f" returned: 0 in 0.469s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b95e6d82-ebce-4b39-a8e8-1a072a00dade tempest-SnapshotsActionsTest-1298817753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.948s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.788s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] Creating offline snapshot 8e135991-bba7-4416-b2ad-c1b205096632 of volume 82c864f7-7241-4b9a-886f-c7fe229c6300 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:09:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b95e6d82-ebce-4b39-a8e8-1a072a00dade tempest-SnapshotsActionsTest-1298817753 None] Create snapshot completed successfully
Sep 25 15:09:30 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36a9df1-df89-4793-923e-b660b61118d2]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:30 devstack sudo[98887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300
Sep 25 15:09:30 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Acquiring lock "cinder-4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:30 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300" returned: 0 in 0.836s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Acquiring lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:31 devstack sudo[98894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632 1G
Sep 25 15:09:31 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Acquiring lock "cinder-quobyte-4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-quobyte-4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Deleting offline snapshot 4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f of volume 0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] snapshot_file for this snap is: volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0d5793-db0d-4751-8ec3-ec619bac0003]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:31 devstack sudo[98896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f
Sep 25 15:09:31 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:31 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632 1G" returned: 0 in 0.720s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82c864f7-7241-4b9a-886f-c7fe229c6300 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:31 devstack sudo[98905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82c864f7-7241-4b9a-886f-c7fe229c6300 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632
Sep 25 15:09:31 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:31 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f" returned: 0 in 0.650s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[101d8548-51a9-4c10-b8df-83292df2f620]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:32 devstack sudo[98907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361
Sep 25 15:09:32 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:32 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82c864f7-7241-4b9a-886f-c7fe229c6300 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632" returned: 0 in 0.449s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:32 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632 is being set with open permissions: ugo+rw
Sep 25 15:09:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:32 devstack sudo[98912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632
Sep 25 15:09:32 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:32 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361" returned: 0 in 0.648s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:09:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:32 devstack sudo[98917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f
Sep 25 15:09:32 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:32 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632" returned: 0 in 0.551s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:32 devstack sudo[98920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.info
Sep 25 15:09:32 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:33 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f" returned: 0 in 0.627s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:33 devstack sudo[98927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f
Sep 25 15:09:33 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:33 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.info" returned: 0 in 0.458s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:33 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.info is being set with open permissions: ugo+rw
Sep 25 15:09:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:33 devstack sudo[98929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.info
Sep 25 15:09:33 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:33 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f" returned: 0 in 0.400s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-quobyte-4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f" released by "_delete_snapshot" :: held 2.511s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:33 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" released by "delete_snapshot" :: held 2.558s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.info" returned: 0 in 0.390s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.622s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-662dbf80-7fb7-44c8-b9e5-50d5d3b69c08 tempest-VolumesSnapshotTestJSON-698939427 None] Create snapshot completed successfully
Sep 25 15:09:33 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Created reservations ['1720b752-2f0c-4d0d-8dc2-128fb23bc613', 'ea7f776c-4869-4620-8c3f-4f5edf717db4', '62a0a94c-9033-4802-a0c7-80214139492c', '81812bc3-36b3-4f3b-8972-1169ae411f77'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:09:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Delete snapshot completed successfully.
Sep 25 15:09:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e29ec538-36df-4089-9c0c-cdf6e983b44c tempest-SnapshotsActionsTest-1467432064 None] Lock "cinder-4cb6497f-9a9e-4867-a2d4-e2fa338e1b4f-delete_snapshot" released by "delete_snapshot" :: held 2.840s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Acquiring lock "cinder-b6665096-e96b-4ef6-bc8d-ddef2cd23361-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Lock "cinder-b6665096-e96b-4ef6-bc8d-ddef2cd23361-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Acquiring lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Acquiring lock "cinder-quobyte-b6665096-e96b-4ef6-bc8d-ddef2cd23361" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Lock "cinder-quobyte-b6665096-e96b-4ef6-bc8d-ddef2cd23361" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Deleting offline snapshot b6665096-e96b-4ef6-bc8d-ddef2cd23361 of volume 0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] snapshot_file for this snap is: volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bae52d0-54c8-4483-8a27-cde18a8aea58]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:35 devstack sudo[98934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361
Sep 25 15:09:35 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Flow 'volume_create_manager' (df9065dc-d0d8-4333-b9ff-bf18892e2f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fefae2e-d8a3-40a5-a3ca-1de82de6c188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fefae2e-d8a3-40a5-a3ca-1de82de6c188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1397740749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e743e1-b4f9-4b67-989b-7a8317e2d18f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8344c06e0c8b4bce89e92bae73929d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e135991-bba7-4416-b2ad-c1b205096632,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:09:36Z,use_quota=True,user_id='9a7d3786e7154231a065362de14b35e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fafbb9e8-5bdf-4d25-8b2d-033e67a083d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fafbb9e8-5bdf-4d25-8b2d-033e67a083d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd6ecb0-730c-491d-8686-0b6837327324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd6ecb0-730c-491d-8686-0b6837327324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '62e743e1-b4f9-4b67-989b-7a8317e2d18f', 'volume_name': 'volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f', 'volume_size': 1, 'snapshot_id': '8e135991-bba7-4416-b2ad-c1b205096632'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123a3323-b4c7-4572-a21d-7399aa21ce6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123a3323-b4c7-4572-a21d-7399aa21ce6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d34aea-f7c3-4954-9875-ebaeed30c311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:35 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Volume 62e743e1-b4f9-4b67-989b-7a8317e2d18f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f', 'volume_size': 1, 'snapshot_id': '8e135991-bba7-4416-b2ad-c1b205096632'}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-quobyte-8e135991-bba7-4416-b2ad-c1b205096632-62e743e1-b4f9-4b67-989b-7a8317e2d18f" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:35 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361" returned: 0 in 0.618s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-8e135991-bba7-4416-b2ad-c1b205096632-62e743e1-b4f9-4b67-989b-7a8317e2d18f" acquired by "_create_volume_from_snapshot" :: waited 0.057s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Creating volume 62e743e1-b4f9-4b67-989b-7a8317e2d18f from snapshot 8e135991-bba7-4416-b2ad-c1b205096632 {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-quobyte-62e743e1-b4f9-4b67-989b-7a8317e2d18f" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[86523f5b-56cf-48b4-b063-79498191f6bc]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-62e743e1-b4f9-4b67-989b-7a8317e2d18f" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] snapshot: 8e135991-bba7-4416-b2ad-c1b205096632, volume: 62e743e1-b4f9-4b67-989b-7a8317e2d18f,  {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 15:09:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:36 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a890b2-32c1-46a4-99ed-db3528d40e4d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:36 devstack sudo[98940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1
Sep 25 15:09:36 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:36 devstack sudo[98941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632
Sep 25 15:09:36 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:36 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" returned: 0 in 0.680s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:36 devstack sudo[98949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361
Sep 25 15:09:36 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:36 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632" returned: 0 in 0.659s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82c864f7-7241-4b9a-886f-c7fe229c6300(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:09:36 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[790db9a5-5102-49fe-8a36-23cf2433e916]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:36 devstack sudo[98953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300
Sep 25 15:09:36 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:37 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361" returned: 0 in 0.683s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:37 devstack sudo[98964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361
Sep 25 15:09:37 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:37 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300" returned: 0 in 0.552s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 15:09:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 15:09:37 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Path /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 15:09:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:37 devstack sudo[98966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f
Sep 25 15:09:37 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:37 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1.b6665096-e96b-4ef6-bc8d-ddef2cd23361" returned: 0 in 0.410s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Lock "cinder-quobyte-b6665096-e96b-4ef6-bc8d-ddef2cd23361" released by "_delete_snapshot" :: held 2.616s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" released by "delete_snapshot" :: held 2.652s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:37 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Created reservations ['deb4359b-118d-4921-b059-3d52a3fe2b58', 'ee58ed95-6660-4248-92c9-e67a6509c606', 'b6d888e7-9728-4f65-b684-31562fe8d7b3', '8393f0f0-2f4a-40e5-a046-702e5fcdcad9'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:09:38 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Delete snapshot completed successfully.
Sep 25 15:09:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9f706a2b-7bee-437f-b186-3e69d96e108c tempest-SnapshotsActionsTest-1298817753 None] Lock "cinder-b6665096-e96b-4ef6-bc8d-ddef2cd23361-delete_snapshot" released by "delete_snapshot" :: held 2.989s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Acquiring lock "cinder-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Lock "cinder-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Acquiring lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" acquired by "delete_volume" :: waited 0.042s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:39 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8988c1c5-7001-4504-b8c3-46b5078dbe4d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:39 devstack sudo[98980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1
Sep 25 15:09:39 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:40 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" returned: 0 in 1.172s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:40 devstack sudo[99007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1
Sep 25 15:09:40 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:41 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" returned: 0 in 0.813s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Lock "cinder-quobyte-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1" released by "delete_volume" :: held 2.252s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:41 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Created reservations ['cb88dedb-24ee-486f-ac15-fcd36b7f69eb', '54061f67-9969-477a-8cd4-299b79b3e129', '5cbe5c72-7e45-45ba-b144-7a49c9d776f7', '28d2fa6c-69e8-4302-baf2-36ba63c5055f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:09:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:41 devstack sudo[99010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:09:41 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:42 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.539s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:42 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:09:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Deleted volume successfully.
Sep 25 15:09:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7b94b90a-4690-4a13-ae59-6cef99e02d17 tempest-SnapshotsActionsTest-1298817753 None] Lock "cinder-0e394cdf-d06d-4c29-aef9-c1a6594e5cd1-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:48 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f" returned: 0 in 10.888s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:48 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Image conversion details: src /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300, size 1024.00 MB, duration 10.89 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:09:48 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Converted 1024.00 MB image at 94.03 MB/s
Sep 25 15:09:48 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f is being set with open permissions: ugo+rw
Sep 25 15:09:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:48 devstack sudo[99015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f
Sep 25 15:09:48 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:48 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f" returned: 0 in 0.484s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-62e743e1-b4f9-4b67-989b-7a8317e2d18f" released by "_copy_volume_from_snapshot" :: held 12.766s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-8e135991-bba7-4416-b2ad-c1b205096632-62e743e1-b4f9-4b67-989b-7a8317e2d18f" released by "_create_volume_from_snapshot" :: held 12.905s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.963s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d34aea-f7c3-4954-9875-ebaeed30c311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f', 'volume_size': 1, 'snapshot_id': '8e135991-bba7-4416-b2ad-c1b205096632'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f847f315-0f1b-4c32-9379-de5ed0a1b452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:09:48 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Volume volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f (62e743e1-b4f9-4b67-989b-7a8317e2d18f): created successfully
Sep 25 15:09:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f847f315-0f1b-4c32-9379-de5ed0a1b452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:09:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Flow 'volume_create_manager' (df9065dc-d0d8-4333-b9ff-bf18892e2f06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:09:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0f133e7f-5958-475e-ba9b-cbe1b9b32a91 tempest-VolumesSnapshotTestJSON-698939427 None] Created volume successfully.
Sep 25 15:09:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-62e743e1-b4f9-4b67-989b-7a8317e2d18f-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-62e743e1-b4f9-4b67-989b-7a8317e2d18f-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:49 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=119,cinder:SELECT=107,cinder:DELETE=6,cinder:INSERT=29 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:09:49 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=119,cinder:SELECT=106,cinder:INSERT=29,cinder:DELETE=10 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:09:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-quobyte-62e743e1-b4f9-4b67-989b-7a8317e2d18f" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-62e743e1-b4f9-4b67-989b-7a8317e2d18f" acquired by "delete_volume" :: waited 0.049s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:50 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dab269-5dbc-4b1e-84a2-5b202506a138]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:50 devstack sudo[99019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f
Sep 25 15:09:50 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:50 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f" returned: 0 in 0.569s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:50 devstack sudo[99024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f
Sep 25 15:09:50 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:51 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62e743e1-b4f9-4b67-989b-7a8317e2d18f" returned: 0 in 0.457s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-62e743e1-b4f9-4b67-989b-7a8317e2d18f" released by "delete_volume" :: held 1.145s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:51 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Created reservations ['ddc9ff4b-d707-4487-b353-ca26a11e4c9f', '22ae5a1f-66b5-4768-9280-85550c4c6579', 'e83813dd-d478-45e2-9639-6d4b286f4ed3', 'e049ad52-b78a-4959-9733-427a252b6193'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:09:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:51 devstack sudo[99027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:09:51 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:51 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.386s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:51 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:09:51 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Deleted volume successfully.
Sep 25 15:09:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c1015a12-68c0-4279-9337-5aa99c8bd1a6 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-62e743e1-b4f9-4b67-989b-7a8317e2d18f-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-8e135991-bba7-4416-b2ad-c1b205096632-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-8e135991-bba7-4416-b2ad-c1b205096632-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-quobyte-82c864f7-7241-4b9a-886f-c7fe229c6300" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-82c864f7-7241-4b9a-886f-c7fe229c6300" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-quobyte-8e135991-bba7-4416-b2ad-c1b205096632" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-8e135991-bba7-4416-b2ad-c1b205096632" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Deleting offline snapshot 8e135991-bba7-4416-b2ad-c1b205096632 of volume 82c864f7-7241-4b9a-886f-c7fe229c6300 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:09:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] snapshot_file for this snap is: volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:09:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[141ee56c-726f-43c5-be32-d0dd2b2d8847]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:52 devstack sudo[99032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632
Sep 25 15:09:52 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:53 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632" returned: 0 in 0.600s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82c864f7-7241-4b9a-886f-c7fe229c6300(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:09:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a63bec-b89e-4145-9de9-f8b81502327b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:53 devstack sudo[99039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300
Sep 25 15:09:53 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:54 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300" returned: 0 in 0.990s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:54 devstack sudo[99047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632
Sep 25 15:09:54 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:54 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632" returned: 0 in 0.492s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:54 devstack sudo[99059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632
Sep 25 15:09:54 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:54 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300.8e135991-bba7-4416-b2ad-c1b205096632" returned: 0 in 0.334s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-8e135991-bba7-4416-b2ad-c1b205096632" released by "_delete_snapshot" :: held 2.645s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-82c864f7-7241-4b9a-886f-c7fe229c6300" released by "delete_snapshot" :: held 2.680s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-14f3bbbc-dc1a-46ae-8776-42ba9508390a req-a9a97f2c-b874-48d5-87a5-fb220db3890c tempest-TestServerVolumeAttachmentScenario-1166186409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-14f3bbbc-dc1a-46ae-8776-42ba9508390a req-a9a97f2c-b874-48d5-87a5-fb220db3890c tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:55 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Created reservations ['603cd423-8861-412b-8c3b-43fb6568b887', '51f83fd1-2104-4792-9c53-dd171e455ede', '99aafe51-ade8-4026-a5db-504639d22545', '14b5bebd-8173-46dd-be97-22dc0f29158a'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:09:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-14f3bbbc-dc1a-46ae-8776-42ba9508390a req-a9a97f2c-b874-48d5-87a5-fb220db3890c tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-14f3bbbc-dc1a-46ae-8776-42ba9508390a req-a9a97f2c-b874-48d5-87a5-fb220db3890c tempest-TestServerVolumeAttachmentScenario-1166186409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-8438668e-9386-4d2c-a47f-98ce96860ad9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af9017f7-ef66-4f6e-a069-b8b1f8cefb39', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:09:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Delete snapshot completed successfully.
Sep 25 15:09:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-abd263ef-1879-48cd-a01c-cdba73ab64b8 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-8e135991-bba7-4416-b2ad-c1b205096632-delete_snapshot" released by "delete_snapshot" :: held 2.959s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-14f3bbbc-dc1a-46ae-8776-42ba9508390a req-a9a97f2c-b874-48d5-87a5-fb220db3890c tempest-TestServerVolumeAttachmentScenario-1166186409 None] attachment_update completed successfully.
Sep 25 15:09:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-82c864f7-7241-4b9a-886f-c7fe229c6300-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-82c864f7-7241-4b9a-886f-c7fe229c6300-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-quobyte-82c864f7-7241-4b9a-886f-c7fe229c6300" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-82c864f7-7241-4b9a-886f-c7fe229c6300" acquired by "delete_volume" :: waited 0.048s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:55 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[54203b06-d585-4da0-b2a9-857979514452]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:56 devstack sudo[99484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300
Sep 25 15:09:56 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:56 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300" returned: 0 in 0.677s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:56 devstack sudo[99491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300
Sep 25 15:09:56 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:57 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-82c864f7-7241-4b9a-886f-c7fe229c6300" returned: 0 in 0.458s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-82c864f7-7241-4b9a-886f-c7fe229c6300" released by "delete_volume" :: held 1.290s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:57 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Created reservations ['c0d3111e-8cb7-497c-bdb1-f765b5959776', '29f0a7a5-1a84-45df-a7f7-71839ee9b5cb', '8858f9e6-70d4-41ab-bfb0-f07f20f6973f', '858c6ee6-89ce-42d4-b8ad-ec2ddb464cc7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:09:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:57 devstack sudo[99495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:09:57 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:57 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.342s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:57 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:09:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Deleted volume successfully.
Sep 25 15:09:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b4324fda-fd4c-4559-a094-d44b9c99c204 tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-82c864f7-7241-4b9a-886f-c7fe229c6300-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-4986c42e-f601-4b96-a677-f274230040cf-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-4986c42e-f601-4b96-a677-f274230040cf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "cinder-quobyte-4986c42e-f601-4b96-a677-f274230040cf" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:09:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-4986c42e-f601-4b96-a677-f274230040cf" acquired by "delete_volume" :: waited 0.046s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:09:58 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed00b1f-17ea-4c60-ad2e-9438a3bf51b8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:09:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:58 devstack sudo[99532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf
Sep 25 15:09:58 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:59 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf" returned: 0 in 0.774s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:59 devstack sudo[99539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf
Sep 25 15:09:59 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:09:59 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root
Sep 25 15:09:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4986c42e-f601-4b96-a677-f274230040cf" returned: 0 in 0.354s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:09:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-quobyte-4986c42e-f601-4b96-a677-f274230040cf" released by "delete_volume" :: held 1.269s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:09:59 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Created reservations ['ce99e510-2b89-4283-9675-9f7970865fff', 'f4a88114-4f64-418f-b561-0b9d328550af', '609af629-67a8-4618-bb0f-511204d049d5', 'fa7d0338-3cc0-4562-8f2e-c55d6305c902'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:09:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:09:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:09:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:09:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:09:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:09:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:09:59 devstack sudo[99542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:09:59 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:00 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.359s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:00 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:10:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Deleted volume successfully.
Sep 25 15:10:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1680f071-0f1a-42c8-88e3-4f9efc93a0ce tempest-VolumesSnapshotTestJSON-698939427 None] Lock "cinder-4986c42e-f601-4b96-a677-f274230040cf-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-5ffe2cf9-e8f5-42e8-be45-13e333661b59 req-28319930-3ab4-484a-9105-43d46a367a7e tempest-TestServerVolumeAttachmentScenario-1166186409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-5ffe2cf9-e8f5-42e8-be45-13e333661b59 req-28319930-3ab4-484a-9105-43d46a367a7e tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-5ffe2cf9-e8f5-42e8-be45-13e333661b59 req-28319930-3ab4-484a-9105-43d46a367a7e tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5ffe2cf9-e8f5-42e8-be45-13e333661b59 req-28319930-3ab4-484a-9105-43d46a367a7e tempest-TestServerVolumeAttachmentScenario-1166186409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b91c2f1-4cc6-4bca-b7a0-941adb10fc80', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:10:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-5ffe2cf9-e8f5-42e8-be45-13e333661b59 req-28319930-3ab4-484a-9105-43d46a367a7e tempest-TestServerVolumeAttachmentScenario-1166186409 None] attachment_update completed successfully.
Sep 25 15:10:06 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-a5188864-690a-4bdd-8747-0fe9fb605321 req-073048cb-8e5e-4365-9006-949bbc7714c4 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Terminate volume connection completed successfully.
Sep 25 15:10:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-a5188864-690a-4bdd-8747-0fe9fb605321 req-073048cb-8e5e-4365-9006-949bbc7714c4 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Deleting attachment 2b91c2f1-4cc6-4bca-b7a0-941adb10fc80. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:10:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-2914f753-4ada-46ef-9c37-c83ed43b3353 req-dc1bc969-9404-4b65-bcbe-adfa9781f789 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Terminate volume connection completed successfully.
Sep 25 15:10:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-2914f753-4ada-46ef-9c37-c83ed43b3353 req-dc1bc969-9404-4b65-bcbe-adfa9781f789 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Deleting attachment af9017f7-ef66-4f6e-a069-b8b1f8cefb39. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:10:16 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=39,cinder:INSERT=9,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:10:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Acquiring lock "cinder-9d768c3b-111c-4bb4-b1a7-c88a26db31ad-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "cinder-9d768c3b-111c-4bb4-b1a7-c88a26db31ad-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Acquiring lock "cinder-quobyte-9d768c3b-111c-4bb4-b1a7-c88a26db31ad" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "cinder-quobyte-9d768c3b-111c-4bb4-b1a7-c88a26db31ad" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:16 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea9618d-cee9-42ea-b0d1-9a0b785a7f26]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:10:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:16 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Flow 'volume_create_manager' (59852772-8321-4ae1-b460-272870cd39e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cebc2d3-de79-420b-ad00-2099bca6690d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cebc2d3-de79-420b-ad00-2099bca6690d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2144153543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=112035db-1950-45b1-94b0-2daea1df9137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e0a24ff6d4d4a8190fb45f40793a5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:10:17Z,use_quota=True,user_id='924d0c29d0754d3883ed8c69d1afa3dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10cf814-3ff8-46b9-a771-7d546cc7c7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10cf814-3ff8-46b9-a771-7d546cc7c7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad07e763-d245-477b-b470-90f49c55e8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad07e763-d245-477b-b470-90f49c55e8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '112035db-1950-45b1-94b0-2daea1df9137', 'volume_name': 'volume-112035db-1950-45b1-94b0-2daea1df9137', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0e67531-27e8-4b6f-b04b-631a8fcc5ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0e67531-27e8-4b6f-b04b-631a8fcc5ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:17 devstack sudo[99631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a714be-b2e1-4662-b5ab-0b7bfe90b26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:17 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Volume 112035db-1950-45b1-94b0-2daea1df9137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-112035db-1950-45b1-94b0-2daea1df9137', 'volume_size': 1}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:17 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2144153543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=112035db-1950-45b1-94b0-2daea1df9137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e0a24ff6d4d4a8190fb45f40793a5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:10:17Z,use_quota=True,user_id='924d0c29d0754d3883ed8c69d1afa3dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Creating volume 112035db-1950-45b1-94b0-2daea1df9137 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:10:17 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:17 devstack sudo[99633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137 1073741824
Sep 25 15:10:17 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:17 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad" returned: 0 in 0.682s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:17 devstack sudo[99642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad
Sep 25 15:10:17 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:17 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137 1073741824" returned: 0 in 0.691s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:17 devstack sudo[99645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137
Sep 25 15:10:17 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:18 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9d768c3b-111c-4bb4-b1a7-c88a26db31ad" returned: 0 in 0.518s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "cinder-quobyte-9d768c3b-111c-4bb4-b1a7-c88a26db31ad" released by "delete_volume" :: held 1.285s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Created reservations ['14b948ec-0795-45d8-b6f2-29114b984bfd', '88c1e749-98de-4299-b4b6-938de1176237', '41240efb-7337-4a9f-812b-157a1f85c754', '49011a53-5e64-49b0-a99c-6501860b6aee'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:18 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137" returned: 0 in 0.479s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:18 devstack sudo[99649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:10:18 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a714be-b2e1-4662-b5ab-0b7bfe90b26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-112035db-1950-45b1-94b0-2daea1df9137', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0cba68-b269-49d4-a64b-62ad75647666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:18 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Volume volume-112035db-1950-45b1-94b0-2daea1df9137 (112035db-1950-45b1-94b0-2daea1df9137): created successfully
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0cba68-b269-49d4-a64b-62ad75647666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Flow 'volume_create_manager' (59852772-8321-4ae1-b460-272870cd39e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:10:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-be5cf212-c9a2-445f-be2d-275a8711f8df tempest-VolumesSnapshotListTestJSON-693982919 None] Created volume successfully.
Sep 25 15:10:18 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.428s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:10:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Deleted volume successfully.
Sep 25 15:10:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c59146e6-801f-462a-a22a-53c4e7dc986a tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "cinder-9d768c3b-111c-4bb4-b1a7-c88a26db31ad-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Acquiring lock "cinder-8438668e-9386-4d2c-a47f-98ce96860ad9-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "cinder-8438668e-9386-4d2c-a47f-98ce96860ad9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Acquiring lock "cinder-quobyte-8438668e-9386-4d2c-a47f-98ce96860ad9" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "cinder-quobyte-8438668e-9386-4d2c-a47f-98ce96860ad9" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[82492acc-4ff9-499c-aec3-67f4f8dddd4a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:10:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8438668e-9386-4d2c-a47f-98ce96860ad9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:19 devstack sudo[99652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8438668e-9386-4d2c-a47f-98ce96860ad9
Sep 25 15:10:19 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] Creating offline snapshot ca819242-4173-41d3-8cef-9503d9bc8c93 of volume 112035db-1950-45b1-94b0-2daea1df9137 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:10:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbf9b3d-c4ed-4146-9fd5-a29aa15e2ec8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:10:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:19 devstack sudo[99654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137
Sep 25 15:10:19 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:19 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8438668e-9386-4d2c-a47f-98ce96860ad9" returned: 0 in 0.574s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8438668e-9386-4d2c-a47f-98ce96860ad9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:19 devstack sudo[99659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8438668e-9386-4d2c-a47f-98ce96860ad9
Sep 25 15:10:20 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:20 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137" returned: 0 in 0.614s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:20 devstack sudo[99665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93 1G
Sep 25 15:10:20 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:20 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8438668e-9386-4d2c-a47f-98ce96860ad9" returned: 0 in 0.419s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "cinder-quobyte-8438668e-9386-4d2c-a47f-98ce96860ad9" released by "delete_volume" :: held 1.079s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Created reservations ['40b06d85-d1e4-4d5b-bcfa-e6678059e986', '715e9f7d-680c-4cd9-8eb1-1532ef31696f', '59a1179b-a004-40d7-a857-3646577c172d', '2d9837d7-7d78-4c26-8bf1-e4be8bad6cca'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:10:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:10:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:10:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:10:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:10:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:10:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:20 devstack sudo[99670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:10:20 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:21 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93 1G" returned: 0 in 0.757s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112035db-1950-45b1-94b0-2daea1df9137 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:21 devstack sudo[99673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112035db-1950-45b1-94b0-2daea1df9137 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93
Sep 25 15:10:21 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:21 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.496s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:10:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Deleted volume successfully.
Sep 25 15:10:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4230be85-16f9-4018-9418-adca647aa8e6 tempest-TestServerVolumeAttachmentScenario-1166186409 None] Lock "cinder-8438668e-9386-4d2c-a47f-98ce96860ad9-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:21 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112035db-1950-45b1-94b0-2daea1df9137 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93" returned: 0 in 0.516s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:21 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93 is being set with open permissions: ugo+rw
Sep 25 15:10:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:21 devstack sudo[99679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93
Sep 25 15:10:21 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:22 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93" returned: 0 in 0.523s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:22 devstack sudo[99682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.info
Sep 25 15:10:22 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:22 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.info" returned: 0 in 0.354s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:22 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.info is being set with open permissions: ugo+rw
Sep 25 15:10:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:22 devstack sudo[99685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.info
Sep 25 15:10:22 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:22 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.info" returned: 0 in 0.491s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.462s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c54fd9b3-b461-44ac-b4ef-badc4b962d5d tempest-VolumesSnapshotListTestJSON-693982919 None] Create snapshot completed successfully
Sep 25 15:10:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-84273115-0a6a-424a-84a7-2f158fe082bc tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-84273115-0a6a-424a-84a7-2f158fe082bc tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-84273115-0a6a-424a-84a7-2f158fe082bc tempest-VolumesSnapshotListTestJSON-693982919 None] Creating offline snapshot c2a7531c-ad84-4f58-906b-b4ff02afc94a of volume 112035db-1950-45b1-94b0-2daea1df9137 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:10:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16ad852-e7d6-4464-be8e-090e0868866e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:10:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-84273115-0a6a-424a-84a7-2f158fe082bc tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:24 devstack sudo[99689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93
Sep 25 15:10:24 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:25 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-84273115-0a6a-424a-84a7-2f158fe082bc tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93" returned: 0 in 0.673s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-84273115-0a6a-424a-84a7-2f158fe082bc tempest-VolumesSnapshotListTestJSON-693982919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112035db-1950-45b1-94b0-2daea1df9137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:10:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-84273115-0a6a-424a-84a7-2f158fe082bc tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:25 devstack sudo[99694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a 1G
Sep 25 15:10:25 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:25 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-84273115-0a6a-424a-84a7-2f158fe082bc tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a 1G" returned: 0 in 0.685s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-84273115-0a6a-424a-84a7-2f158fe082bc tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:25 devstack sudo[99700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a
Sep 25 15:10:25 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:26 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-84273115-0a6a-424a-84a7-2f158fe082bc tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a" returned: 0 in 0.462s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:26 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-84273115-0a6a-424a-84a7-2f158fe082bc tempest-VolumesSnapshotListTestJSON-693982919 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a is being set with open permissions: ugo+rw
Sep 25 15:10:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-84273115-0a6a-424a-84a7-2f158fe082bc tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:26 devstack sudo[99707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a
Sep 25 15:10:26 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:26 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-84273115-0a6a-424a-84a7-2f158fe082bc tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a" returned: 0 in 0.307s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-84273115-0a6a-424a-84a7-2f158fe082bc tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.282s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-84273115-0a6a-424a-84a7-2f158fe082bc tempest-VolumesSnapshotListTestJSON-693982919 None] Create snapshot completed successfully
Sep 25 15:10:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4e9cd1c-07f6-4d47-9a07-d5ab6e76d46a tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4e9cd1c-07f6-4d47-9a07-d5ab6e76d46a tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f4e9cd1c-07f6-4d47-9a07-d5ab6e76d46a tempest-VolumesSnapshotListTestJSON-693982919 None] Creating offline snapshot 3f377bb2-4a96-4b71-80ac-1591f11e6175 of volume 112035db-1950-45b1-94b0-2daea1df9137 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:10:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cef13d-aaf2-4d55-b535-4d55e3d29ece]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:10:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e9cd1c-07f6-4d47-9a07-d5ab6e76d46a tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:28 devstack sudo[99711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a
Sep 25 15:10:28 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:28 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e9cd1c-07f6-4d47-9a07-d5ab6e76d46a tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a" returned: 0 in 0.758s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f4e9cd1c-07f6-4d47-9a07-d5ab6e76d46a tempest-VolumesSnapshotListTestJSON-693982919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112035db-1950-45b1-94b0-2daea1df9137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:10:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e9cd1c-07f6-4d47-9a07-d5ab6e76d46a tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:28 devstack sudo[99716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175 1G
Sep 25 15:10:28 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:29 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e9cd1c-07f6-4d47-9a07-d5ab6e76d46a tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175 1G" returned: 0 in 0.791s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e9cd1c-07f6-4d47-9a07-d5ab6e76d46a tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:29 devstack sudo[99722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175
Sep 25 15:10:29 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:30 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e9cd1c-07f6-4d47-9a07-d5ab6e76d46a tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175" returned: 0 in 0.529s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:30 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-f4e9cd1c-07f6-4d47-9a07-d5ab6e76d46a tempest-VolumesSnapshotListTestJSON-693982919 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175 is being set with open permissions: ugo+rw
Sep 25 15:10:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e9cd1c-07f6-4d47-9a07-d5ab6e76d46a tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:30 devstack sudo[99728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175
Sep 25 15:10:30 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:30 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4e9cd1c-07f6-4d47-9a07-d5ab6e76d46a tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175" returned: 0 in 0.347s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4e9cd1c-07f6-4d47-9a07-d5ab6e76d46a tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.643s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f4e9cd1c-07f6-4d47-9a07-d5ab6e76d46a tempest-VolumesSnapshotListTestJSON-693982919 None] Create snapshot completed successfully
Sep 25 15:10:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "cinder-3f377bb2-4a96-4b71-80ac-1591f11e6175-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-3f377bb2-4a96-4b71-80ac-1591f11e6175-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "cinder-quobyte-112035db-1950-45b1-94b0-2daea1df9137" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-quobyte-112035db-1950-45b1-94b0-2daea1df9137" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "cinder-quobyte-3f377bb2-4a96-4b71-80ac-1591f11e6175" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-quobyte-3f377bb2-4a96-4b71-80ac-1591f11e6175" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Deleting offline snapshot 3f377bb2-4a96-4b71-80ac-1591f11e6175 of volume 112035db-1950-45b1-94b0-2daea1df9137 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:10:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] snapshot_file for this snap is: volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:10:32 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0debe35-3a0d-414f-9cee-2c46c6a4bbe4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:10:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:33 devstack sudo[99731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175
Sep 25 15:10:33 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:33 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175" returned: 0 in 0.699s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112035db-1950-45b1-94b0-2daea1df9137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:10:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb0ef1b-724a-41a7-9e80-1c2459f88954]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:10:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:33 devstack sudo[99736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a
Sep 25 15:10:33 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:34 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a" returned: 0 in 0.551s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112035db-1950-45b1-94b0-2daea1df9137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:10:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:34 devstack sudo[99743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175
Sep 25 15:10:34 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:34 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175" returned: 0 in 0.751s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:34 devstack sudo[99751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175
Sep 25 15:10:34 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:35 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.3f377bb2-4a96-4b71-80ac-1591f11e6175" returned: 0 in 0.413s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-quobyte-3f377bb2-4a96-4b71-80ac-1591f11e6175" released by "_delete_snapshot" :: held 2.578s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-quobyte-112035db-1950-45b1-94b0-2daea1df9137" released by "delete_snapshot" :: held 2.623s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:35 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Created reservations ['4866ac7b-3b3d-4e06-a0d8-3dc519da2933', 'f306fab8-f261-470a-aa41-9fa755ec4703', '9e41a667-c3b7-4bfd-9563-27d8f71342c6', 'cb9bad30-d776-4c2a-8a72-231a0d40b9d7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:10:35 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Delete snapshot completed successfully.
Sep 25 15:10:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3f2140db-d664-481e-b6f7-34cfc191869d tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-3f377bb2-4a96-4b71-80ac-1591f11e6175-delete_snapshot" released by "delete_snapshot" :: held 2.881s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "cinder-c2a7531c-ad84-4f58-906b-b4ff02afc94a-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-c2a7531c-ad84-4f58-906b-b4ff02afc94a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "cinder-quobyte-112035db-1950-45b1-94b0-2daea1df9137" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-quobyte-112035db-1950-45b1-94b0-2daea1df9137" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "cinder-quobyte-c2a7531c-ad84-4f58-906b-b4ff02afc94a" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-quobyte-c2a7531c-ad84-4f58-906b-b4ff02afc94a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Deleting offline snapshot c2a7531c-ad84-4f58-906b-b4ff02afc94a of volume 112035db-1950-45b1-94b0-2daea1df9137 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:10:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] snapshot_file for this snap is: volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:10:36 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c56ac6-0df6-4e79-a6e6-61a24c9c98b9]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:10:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:36 devstack sudo[99754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a
Sep 25 15:10:36 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:36 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a" returned: 0 in 0.658s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112035db-1950-45b1-94b0-2daea1df9137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:10:36 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[458e9055-c81b-4ada-961a-8e86d885d445]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:10:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:36 devstack sudo[99761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93
Sep 25 15:10:36 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:37 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93" returned: 0 in 0.692s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112035db-1950-45b1-94b0-2daea1df9137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:10:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:37 devstack sudo[99767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a
Sep 25 15:10:37 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:38 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a" returned: 0 in 0.697s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:38 devstack sudo[99773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a
Sep 25 15:10:38 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:38 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.c2a7531c-ad84-4f58-906b-b4ff02afc94a" returned: 0 in 0.393s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-quobyte-c2a7531c-ad84-4f58-906b-b4ff02afc94a" released by "_delete_snapshot" :: held 2.659s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-quobyte-112035db-1950-45b1-94b0-2daea1df9137" released by "delete_snapshot" :: held 2.691s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Flow 'volume_create_manager' (875ce633-3147-4194-b5c4-b43adc11f653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6e7dd2-6618-4128-a6f5-67a1e2dfc954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6e7dd2-6618-4128-a6f5-67a1e2dfc954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-341623928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a030094-0f3d-4070-a938-2ea4afcb184d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74e8fc70ce84f3c9b43abeda10b1db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:10:39Z,use_quota=True,user_id='4d4c986b728c4ad0996fc3949523417f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551256e4-5f6b-40ba-9dbd-f21e99ebec8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551256e4-5f6b-40ba-9dbd-f21e99ebec8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83969f23-cd3c-4c30-8b70-9c521e98116f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83969f23-cd3c-4c30-8b70-9c521e98116f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a030094-0f3d-4070-a938-2ea4afcb184d', 'volume_name': 'volume-1a030094-0f3d-4070-a938-2ea4afcb184d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1d35f4-a111-4e0e-bfa2-20d57285b4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1d35f4-a111-4e0e-bfa2-20d57285b4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb51a0ae-466b-4e00-afcd-19f9ce91f9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:38 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Volume 1a030094-0f3d-4070-a938-2ea4afcb184d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a030094-0f3d-4070-a938-2ea4afcb184d', 'volume_size': 1}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-341623928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a030094-0f3d-4070-a938-2ea4afcb184d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74e8fc70ce84f3c9b43abeda10b1db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:10:39Z,use_quota=True,user_id='4d4c986b728c4ad0996fc3949523417f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Creating volume 1a030094-0f3d-4070-a938-2ea4afcb184d {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:10:38 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1a030094-0f3d-4070-a938-2ea4afcb184d 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:38 devstack sudo[99776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1a030094-0f3d-4070-a938-2ea4afcb184d 1073741824
Sep 25 15:10:38 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:38 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Created reservations ['e31929fc-3b22-4e27-8267-f3bcfa2d9e7d', 'a90b5fc4-7319-4b95-aae6-8f85564e8d3a', '09507d79-b5ab-4044-8f35-441bd0d8bfd8', '78f9e506-d994-4431-82de-7919ddf40d64'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:10:39 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Delete snapshot completed successfully.
Sep 25 15:10:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1eead89a-5747-40b8-92fd-aafb9b30bcb8 tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-c2a7531c-ad84-4f58-906b-b4ff02afc94a-delete_snapshot" released by "delete_snapshot" :: held 3.168s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "cinder-ca819242-4173-41d3-8cef-9503d9bc8c93-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-ca819242-4173-41d3-8cef-9503d9bc8c93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "cinder-quobyte-112035db-1950-45b1-94b0-2daea1df9137" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-quobyte-112035db-1950-45b1-94b0-2daea1df9137" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "cinder-quobyte-ca819242-4173-41d3-8cef-9503d9bc8c93" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-quobyte-ca819242-4173-41d3-8cef-9503d9bc8c93" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Deleting offline snapshot ca819242-4173-41d3-8cef-9503d9bc8c93 of volume 112035db-1950-45b1-94b0-2daea1df9137 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:10:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] snapshot_file for this snap is: volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:10:39 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16157d7-1b5a-4932-8b31-c00abf56bab7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:10:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:39 devstack sudo[99781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93
Sep 25 15:10:39 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:39 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1a030094-0f3d-4070-a938-2ea4afcb184d 1073741824" returned: 0 in 0.799s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1a030094-0f3d-4070-a938-2ea4afcb184d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:39 devstack sudo[99784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1a030094-0f3d-4070-a938-2ea4afcb184d
Sep 25 15:10:39 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:40 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93" returned: 0 in 0.647s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112035db-1950-45b1-94b0-2daea1df9137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:10:40 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcbd4be-94d4-480b-a022-154ab951799a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:10:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:40 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1a030094-0f3d-4070-a938-2ea4afcb184d" returned: 0 in 0.379s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:10:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb51a0ae-466b-4e00-afcd-19f9ce91f9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a030094-0f3d-4070-a938-2ea4afcb184d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8529a1-f825-42fb-9f75-2a121020e61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:40 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Volume volume-1a030094-0f3d-4070-a938-2ea4afcb184d (1a030094-0f3d-4070-a938-2ea4afcb184d): created successfully
Sep 25 15:10:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8529a1-f825-42fb-9f75-2a121020e61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Flow 'volume_create_manager' (875ce633-3147-4194-b5c4-b43adc11f653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:10:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d043e7c4-ce5c-41ee-b57e-9dbce02a146f tempest-VolumeQuotasAdminTestJSON-556430445 None] Created volume successfully.
Sep 25 15:10:40 devstack sudo[99790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137
Sep 25 15:10:40 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:40 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137" returned: 0 in 0.573s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:40 devstack sudo[99795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93
Sep 25 15:10:40 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Acquiring lock "cinder-1a030094-0f3d-4070-a938-2ea4afcb184d-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Lock "cinder-1a030094-0f3d-4070-a938-2ea4afcb184d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Acquiring lock "cinder-quobyte-1a030094-0f3d-4070-a938-2ea4afcb184d" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Lock "cinder-quobyte-1a030094-0f3d-4070-a938-2ea4afcb184d" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:41 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bdf1ce-5053-4060-ad79-094994b73b9e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:10:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1a030094-0f3d-4070-a938-2ea4afcb184d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:41 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93" returned: 0 in 0.606s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:41 devstack sudo[99802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93
Sep 25 15:10:41 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:41 devstack sudo[99801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1a030094-0f3d-4070-a938-2ea4afcb184d
Sep 25 15:10:41 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:41 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137.ca819242-4173-41d3-8cef-9503d9bc8c93" returned: 0 in 0.499s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-quobyte-ca819242-4173-41d3-8cef-9503d9bc8c93" released by "_delete_snapshot" :: held 2.509s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-quobyte-112035db-1950-45b1-94b0-2daea1df9137" released by "delete_snapshot" :: held 2.542s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:41 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1a030094-0f3d-4070-a938-2ea4afcb184d" returned: 0 in 0.633s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1a030094-0f3d-4070-a938-2ea4afcb184d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:41 devstack sudo[99813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1a030094-0f3d-4070-a938-2ea4afcb184d
Sep 25 15:10:41 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:42 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Created reservations ['a75f589f-f375-4dc0-8d7c-97894240ef0d', 'd35c7c70-449b-4788-ae9b-f369885ea867', '19694a3d-fd39-42bf-a106-3135b159405a', 'da7bc6c9-6fc0-47e9-957f-da988a068bfb'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:10:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Delete snapshot completed successfully.
Sep 25 15:10:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-38d30a96-5c51-4502-bb9f-8ad85568c8f2 tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-ca819242-4173-41d3-8cef-9503d9bc8c93-delete_snapshot" released by "delete_snapshot" :: held 2.904s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:42 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1a030094-0f3d-4070-a938-2ea4afcb184d" returned: 0 in 0.656s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Lock "cinder-quobyte-1a030094-0f3d-4070-a938-2ea4afcb184d" released by "delete_volume" :: held 1.357s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:42 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Created reservations ['fc486fd8-6988-43db-9406-e1fcdf60dac9', 'a09df8b9-3dd1-4368-adf1-50aee9330466', '8249567b-2221-4815-8145-e7dde9a60f2b', '60b5a49b-bc50-41dd-b989-a201e29bc285'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:10:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "cinder-112035db-1950-45b1-94b0-2daea1df9137-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:10:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:10:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-112035db-1950-45b1-94b0-2daea1df9137-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:42 devstack sudo[99816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:10:42 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "cinder-quobyte-112035db-1950-45b1-94b0-2daea1df9137" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-quobyte-112035db-1950-45b1-94b0-2daea1df9137" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:43 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c150008-2c4f-4e25-a5f2-c355c1473375]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:10:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:43 devstack sudo[99818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137
Sep 25 15:10:43 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:43 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.488s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:43 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:10:43 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Deleted volume successfully.
Sep 25 15:10:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f3e18456-65e2-4aab-81e7-7b9b34201b93 tempest-VolumeQuotasAdminTestJSON-556430445 None] Lock "cinder-1a030094-0f3d-4070-a938-2ea4afcb184d-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:43 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137" returned: 0 in 0.879s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:43 devstack sudo[99825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137
Sep 25 15:10:44 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:44 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-112035db-1950-45b1-94b0-2daea1df9137" returned: 0 in 0.575s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-quobyte-112035db-1950-45b1-94b0-2daea1df9137" released by "delete_volume" :: held 1.635s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Flow 'volume_create_manager' (e73ed5e0-f332-434f-9d2a-9041ee4af84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd3e6f4-23f1-4c2b-913d-22a5d08d4421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd3e6f4-23f1-4c2b-913d-22a5d08d4421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1315794371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b215d956-094b-4e2b-8712-82396b062652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74e8fc70ce84f3c9b43abeda10b1db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:10:44Z,use_quota=True,user_id='4d4c986b728c4ad0996fc3949523417f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f8a963-54ab-4511-9c67-ac351dd9b090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f8a963-54ab-4511-9c67-ac351dd9b090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58d967e-3714-4e62-ac09-625436c70070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58d967e-3714-4e62-ac09-625436c70070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b215d956-094b-4e2b-8712-82396b062652', 'volume_name': 'volume-b215d956-094b-4e2b-8712-82396b062652', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f9d74a2-f0f2-4d57-83ad-f3bf7e240e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f9d74a2-f0f2-4d57-83ad-f3bf7e240e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa06f90b-de61-4bb7-8e7a-34c08ed29e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:44 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Volume b215d956-094b-4e2b-8712-82396b062652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b215d956-094b-4e2b-8712-82396b062652', 'volume_size': 1}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1315794371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b215d956-094b-4e2b-8712-82396b062652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74e8fc70ce84f3c9b43abeda10b1db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:10:44Z,use_quota=True,user_id='4d4c986b728c4ad0996fc3949523417f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Creating volume b215d956-094b-4e2b-8712-82396b062652 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:10:44 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b215d956-094b-4e2b-8712-82396b062652 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:44 devstack sudo[99838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b215d956-094b-4e2b-8712-82396b062652 1073741824
Sep 25 15:10:44 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:44 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Created reservations ['7db2f078-ecec-4bfc-8bf0-23f67a357a86', '98ec7be5-833b-4cde-8f78-579727442922', '1148809f-3115-44a7-8eb2-d7495a20da6f', '5b2d1563-98b8-4d99-a4f5-a886dc220994'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:10:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:10:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:10:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:45 devstack sudo[99846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:10:45 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:45 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b215d956-094b-4e2b-8712-82396b062652 1073741824" returned: 0 in 0.811s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b215d956-094b-4e2b-8712-82396b062652 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:45 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.499s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:45 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:10:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Deleted volume successfully.
Sep 25 15:10:45 devstack sudo[99853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b215d956-094b-4e2b-8712-82396b062652
Sep 25 15:10:45 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-149b34fe-042a-4ae0-99af-ecee3c0408cb tempest-VolumesSnapshotListTestJSON-693982919 None] Lock "cinder-112035db-1950-45b1-94b0-2daea1df9137-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:46 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b215d956-094b-4e2b-8712-82396b062652" returned: 0 in 0.401s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:10:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa06f90b-de61-4bb7-8e7a-34c08ed29e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b215d956-094b-4e2b-8712-82396b062652', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e5eb5e-9e94-48ac-928f-384201ee5a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:46 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Volume volume-b215d956-094b-4e2b-8712-82396b062652 (b215d956-094b-4e2b-8712-82396b062652): created successfully
Sep 25 15:10:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e5eb5e-9e94-48ac-928f-384201ee5a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Flow 'volume_create_manager' (e73ed5e0-f332-434f-9d2a-9041ee4af84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:10:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-09667bf0-8abc-4f0b-9bd4-4596ba3853c8 tempest-VolumeQuotasAdminTestJSON-556430445 None] Created volume successfully.
Sep 25 15:10:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-66623cf6-e6b8-4dc8-97e6-daaad05038fa tempest-VolumeQuotasAdminTestJSON-991062223 None] Transfer volume completed successfully.
Sep 25 15:10:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Acquiring lock "cinder-b215d956-094b-4e2b-8712-82396b062652-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Lock "cinder-b215d956-094b-4e2b-8712-82396b062652-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Acquiring lock "cinder-quobyte-b215d956-094b-4e2b-8712-82396b062652" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Lock "cinder-quobyte-b215d956-094b-4e2b-8712-82396b062652" acquired by "delete_volume" :: waited 0.062s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:49 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed946e7c-a105-46aa-b7fa-69464c1d404f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:10:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b215d956-094b-4e2b-8712-82396b062652 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:50 devstack sudo[99914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b215d956-094b-4e2b-8712-82396b062652
Sep 25 15:10:50 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:50 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b215d956-094b-4e2b-8712-82396b062652" returned: 0 in 0.785s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b215d956-094b-4e2b-8712-82396b062652 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:50 devstack sudo[99945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b215d956-094b-4e2b-8712-82396b062652
Sep 25 15:10:50 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:51 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b215d956-094b-4e2b-8712-82396b062652" returned: 0 in 0.577s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Lock "cinder-quobyte-b215d956-094b-4e2b-8712-82396b062652" released by "delete_volume" :: held 1.560s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:51 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=84,cinder:INSERT=23,cinder:UPDATE=90,cinder:DELETE=8 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:10:51 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Created reservations ['63178ebd-e8a7-4166-85bf-8710b1cfc17f', '42453ee9-dc53-4ea4-8ae0-179378ef7311', '5b66f907-335d-4c36-a48a-617877350fe2', 'c69aa512-a99a-470d-b342-83b157136883'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:10:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:10:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:10:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:51 devstack sudo[99949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:10:51 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:51 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.422s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:51 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:10:51 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Deleted volume successfully.
Sep 25 15:10:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-72ee86fb-9f2c-4d61-add6-ece8fc9ef8fe tempest-VolumeQuotasAdminTestJSON-2113663827 None] Lock "cinder-b215d956-094b-4e2b-8712-82396b062652-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Flow 'volume_create_manager' (631cb6b9-7a11-406e-822a-fe0e9813369d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68a7172-bdae-4c07-afe2-e27f26bc3f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68a7172-bdae-4c07-afe2-e27f26bc3f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-35085677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ddb9f6-c38a-4336-b445-2d2777415004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462622faff5e48c7a49344a6bc710f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:10:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:10:54Z,use_quota=True,user_id='d07c75b61d994da4910e0f44fc3af2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94883feb-a95b-4eb0-a34c-9f39d5f69e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94883feb-a95b-4eb0-a34c-9f39d5f69e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbe4cdb-5ad6-4909-871c-533b6ad76c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbe4cdb-5ad6-4909-871c-533b6ad76c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ddb9f6-c38a-4336-b445-2d2777415004', 'volume_name': 'volume-62ddb9f6-c38a-4336-b445-2d2777415004', 'volume_size': 2}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ce43e2-d49e-4e7a-9f38-8c75829add68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ce43e2-d49e-4e7a-9f38-8c75829add68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c56076b-6051-4da0-8726-d70be30ab4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:54 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Volume 62ddb9f6-c38a-4336-b445-2d2777415004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ddb9f6-c38a-4336-b445-2d2777415004', 'volume_size': 2}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-35085677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ddb9f6-c38a-4336-b445-2d2777415004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462622faff5e48c7a49344a6bc710f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:10:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:10:54Z,use_quota=True,user_id='d07c75b61d994da4910e0f44fc3af2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Creating volume 62ddb9f6-c38a-4336-b445-2d2777415004 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:10:54 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:10:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004 2147483648 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:54 devstack sudo[99956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004 2147483648
Sep 25 15:10:54 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:55 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004 2147483648" returned: 0 in 1.090s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:55 devstack sudo[99968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004
Sep 25 15:10:55 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:55 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:10:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Flow 'volume_create_manager' (2df9a029-e02b-4a32-9467-7bf54694cf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:10:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c29599-63ad-437f-8fe3-62165a7721f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c29599-63ad-437f-8fe3-62165a7721f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-109536702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881140f7-0c3b-430e-86bb-d1e122444da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa66e252a7f406ebb8d2e27114c2d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:10:56Z,use_quota=True,user_id='5bf9e57eb2dc424484bb729aa4cc5977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8baf65a9-485b-4b0e-8187-f35a0d436c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8baf65a9-485b-4b0e-8187-f35a0d436c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f227d38c-f053-4d18-8018-71b2fc89a0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f227d38c-f053-4d18-8018-71b2fc89a0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '881140f7-0c3b-430e-86bb-d1e122444da8', 'volume_name': 'volume-881140f7-0c3b-430e-86bb-d1e122444da8', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ff7716-4298-4763-b553-77daaf4335f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ff7716-4298-4763-b553-77daaf4335f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d763c5e2-ddfa-43c1-a86e-3df3d2c3c932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:56 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Volume 881140f7-0c3b-430e-86bb-d1e122444da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-881140f7-0c3b-430e-86bb-d1e122444da8', 'volume_size': 1}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:56 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004" returned: 0 in 0.582s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.112s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-109536702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881140f7-0c3b-430e-86bb-d1e122444da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa66e252a7f406ebb8d2e27114c2d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:10:56Z,use_quota=True,user_id='5bf9e57eb2dc424484bb729aa4cc5977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Creating volume 881140f7-0c3b-430e-86bb-d1e122444da8 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:10:56 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-881140f7-0c3b-430e-86bb-d1e122444da8 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c56076b-6051-4da0-8726-d70be30ab4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ddb9f6-c38a-4336-b445-2d2777415004', 'volume_size': 2}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06face7-2bb3-411f-b94c-a6828574f3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:56 devstack sudo[99971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-881140f7-0c3b-430e-86bb-d1e122444da8 1073741824
Sep 25 15:10:56 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:56 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Volume volume-62ddb9f6-c38a-4336-b445-2d2777415004 (62ddb9f6-c38a-4336-b445-2d2777415004): created successfully
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06face7-2bb3-411f-b94c-a6828574f3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Flow 'volume_create_manager' (631cb6b9-7a11-406e-822a-fe0e9813369d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:10:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-de401513-3567-4fa2-abef-d59b79f1a893 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Created volume successfully.
Sep 25 15:10:56 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-881140f7-0c3b-430e-86bb-d1e122444da8 1073741824" returned: 0 in 0.805s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-881140f7-0c3b-430e-86bb-d1e122444da8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:57 devstack sudo[99980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-881140f7-0c3b-430e-86bb-d1e122444da8
Sep 25 15:10:57 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:57 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-881140f7-0c3b-430e-86bb-d1e122444da8" returned: 0 in 0.638s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:10:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:10:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d763c5e2-ddfa-43c1-a86e-3df3d2c3c932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-881140f7-0c3b-430e-86bb-d1e122444da8', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefff16e-3ada-4919-9aac-56dfb351f2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:10:57 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Volume volume-881140f7-0c3b-430e-86bb-d1e122444da8 (881140f7-0c3b-430e-86bb-d1e122444da8): created successfully
Sep 25 15:10:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefff16e-3ada-4919-9aac-56dfb351f2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:10:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Flow 'volume_create_manager' (2df9a029-e02b-4a32-9467-7bf54694cf61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:10:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:10:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:10:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5767ba7e-c207-407c-86b2-4a9020d59648 tempest-VolumesActionsTest-1345218368 None] Created volume successfully.
Sep 25 15:10:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Creating offline snapshot 0ec2365f-d7e2-4a6e-aa64-056e0ea824d8 of volume 62ddb9f6-c38a-4336-b445-2d2777415004 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:10:57 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4f826b-e5ab-412e-babc-2e8c37ab2d78]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:10:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b62017a4-205b-4318-aedb-02a78748acdf tempest-VolumesActionsTest-1345218368 None] Acquiring lock "cinder-881140f7-0c3b-430e-86bb-d1e122444da8" by "attach_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:10:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b62017a4-205b-4318-aedb-02a78748acdf tempest-VolumesActionsTest-1345218368 None] Lock "cinder-881140f7-0c3b-430e-86bb-d1e122444da8" acquired by "attach_volume" :: waited 0.052s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:10:58 devstack sudo[99984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004
Sep 25 15:10:58 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:10:58 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b62017a4-205b-4318-aedb-02a78748acdf tempest-VolumesActionsTest-1345218368 None] Attaching volume 881140f7-0c3b-430e-86bb-d1e122444da8 to instance 67b91fca-bf60-4726-aec6-426695179664 at mountpoint /dev/vdb on host None.
Sep 25 15:10:58 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b62017a4-205b-4318-aedb-02a78748acdf tempest-VolumesActionsTest-1345218368 None] Attach volume completed successfully.
Sep 25 15:10:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b62017a4-205b-4318-aedb-02a78748acdf tempest-VolumesActionsTest-1345218368 None] Lock "cinder-881140f7-0c3b-430e-86bb-d1e122444da8" released by "attach_volume" :: held 0.196s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:10:59 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root
Sep 25 15:10:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004" returned: 0 in 1.143s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:10:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8 2G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:10:59 devstack sudo[99989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8 2G
Sep 25 15:10:59 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-aa3ad291-f7ce-4031-bd21-d8e51604eb1e tempest-VolumesActionsTest-779608173 None] Terminate volume connection completed successfully.
Sep 25 15:11:00 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8 2G" returned: 0 in 1.105s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ddb9f6-c38a-4336-b445-2d2777415004 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa3ad291-f7ce-4031-bd21-d8e51604eb1e tempest-VolumesActionsTest-779608173 None] Acquiring lock "cinder-881140f7-0c3b-430e-86bb-d1e122444da8-detach_volume" by "detach_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:00 devstack sudo[100029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ddb9f6-c38a-4336-b445-2d2777415004 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8
Sep 25 15:11:00 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa3ad291-f7ce-4031-bd21-d8e51604eb1e tempest-VolumesActionsTest-779608173 None] Lock "cinder-881140f7-0c3b-430e-86bb-d1e122444da8-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-aa3ad291-f7ce-4031-bd21-d8e51604eb1e tempest-VolumesActionsTest-779608173 None] Detaching volume 881140f7-0c3b-430e-86bb-d1e122444da8 from instance 67b91fca-bf60-4726-aec6-426695179664.
Sep 25 15:11:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-aa3ad291-f7ce-4031-bd21-d8e51604eb1e tempest-VolumesActionsTest-779608173 None] Detach volume completed successfully.
Sep 25 15:11:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa3ad291-f7ce-4031-bd21-d8e51604eb1e tempest-VolumesActionsTest-779608173 None] Lock "cinder-881140f7-0c3b-430e-86bb-d1e122444da8-detach_volume" released by "detach_volume" :: held 0.219s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:00 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5a262491-a279-43e2-b5c3-9a9b039350d3 tempest-VolumesActionsTest-1345218368 None] Acquiring lock "cinder-881140f7-0c3b-430e-86bb-d1e122444da8-detach_volume" by "detach_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ddb9f6-c38a-4336-b445-2d2777415004 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8" returned: 0 in 0.717s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:00 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8 is being set with open permissions: ugo+rw
Sep 25 15:11:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5a262491-a279-43e2-b5c3-9a9b039350d3 tempest-VolumesActionsTest-1345218368 None] Lock "cinder-881140f7-0c3b-430e-86bb-d1e122444da8-detach_volume" acquired by "detach_volume" :: waited 0.056s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5a262491-a279-43e2-b5c3-9a9b039350d3 tempest-VolumesActionsTest-1345218368 None] Volume detach called, but volume not attached.
Sep 25 15:11:00 devstack sudo[100038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8
Sep 25 15:11:00 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5a262491-a279-43e2-b5c3-9a9b039350d3 tempest-VolumesActionsTest-1345218368 None] Lock "cinder-881140f7-0c3b-430e-86bb-d1e122444da8-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:01 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8" returned: 0 in 0.486s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Acquiring lock "cinder-881140f7-0c3b-430e-86bb-d1e122444da8-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:01 devstack sudo[100041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.info
Sep 25 15:11:01 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Lock "cinder-881140f7-0c3b-430e-86bb-d1e122444da8-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Acquiring lock "cinder-quobyte-881140f7-0c3b-430e-86bb-d1e122444da8" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Lock "cinder-quobyte-881140f7-0c3b-430e-86bb-d1e122444da8" acquired by "delete_volume" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:01 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdd8c4f-4ebc-452a-bc35-95d8b1ff5521]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-881140f7-0c3b-430e-86bb-d1e122444da8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:01 devstack sudo[100043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-881140f7-0c3b-430e-86bb-d1e122444da8
Sep 25 15:11:01 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:02 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.info" returned: 0 in 0.833s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:02 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.info is being set with open permissions: ugo+rw
Sep 25 15:11:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:02 devstack sudo[100046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.info
Sep 25 15:11:02 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:02 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-881140f7-0c3b-430e-86bb-d1e122444da8" returned: 0 in 0.752s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-881140f7-0c3b-430e-86bb-d1e122444da8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:02 devstack sudo[100051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-881140f7-0c3b-430e-86bb-d1e122444da8
Sep 25 15:11:02 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:02 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.info" returned: 0 in 0.625s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.159s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a5ae3cc1-dfb9-424e-9a74-8339075ca168 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Create snapshot completed successfully
Sep 25 15:11:03 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-881140f7-0c3b-430e-86bb-d1e122444da8" returned: 0 in 0.696s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Lock "cinder-quobyte-881140f7-0c3b-430e-86bb-d1e122444da8" released by "delete_volume" :: held 1.531s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Created reservations ['6f052623-6717-4140-b46f-1af0b98f249b', '739fbdd1-046b-4e21-b4c9-64757549ab43', 'f656eabd-3c17-48c1-a3f9-442b67d66fb0', '69d3e5d3-2f0a-4729-9707-d96fa4e7b290'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:03 devstack sudo[100055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:11:03 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Acquiring lock "cinder-0ec2365f-d7e2-4a6e-aa64-056e0ea824d8-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "cinder-0ec2365f-d7e2-4a6e-aa64-056e0ea824d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Acquiring lock "cinder-quobyte-62ddb9f6-c38a-4336-b445-2d2777415004" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "cinder-quobyte-62ddb9f6-c38a-4336-b445-2d2777415004" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Acquiring lock "cinder-quobyte-0ec2365f-d7e2-4a6e-aa64-056e0ea824d8" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "cinder-quobyte-0ec2365f-d7e2-4a6e-aa64-056e0ea824d8" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Deleting offline snapshot 0ec2365f-d7e2-4a6e-aa64-056e0ea824d8 of volume 62ddb9f6-c38a-4336-b445-2d2777415004 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] snapshot_file for this snap is: volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6eb8d7-45e9-4031-b07f-1a980b6cf301]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:03 devstack sudo[100057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8
Sep 25 15:11:04 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:04 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.587s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:04 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:11:04 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Deleted volume successfully.
Sep 25 15:11:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-70d67de4-3666-4f3d-b546-5f620d20e5d7 tempest-VolumesActionsTest-1345218368 None] Lock "cinder-881140f7-0c3b-430e-86bb-d1e122444da8-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:04 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8" returned: 0 in 0.685s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62ddb9f6-c38a-4336-b445-2d2777415004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:11:04 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9293dc54-d650-4e45-9729-7f658b8d8561]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:04 devstack sudo[100064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004
Sep 25 15:11:04 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:05 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004" returned: 0 in 0.612s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:05 devstack sudo[100077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8
Sep 25 15:11:05 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:05 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8" returned: 0 in 0.772s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:06 devstack sudo[100097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8
Sep 25 15:11:06 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:06 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004.0ec2365f-d7e2-4a6e-aa64-056e0ea824d8" returned: 0 in 0.449s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "cinder-quobyte-0ec2365f-d7e2-4a6e-aa64-056e0ea824d8" released by "_delete_snapshot" :: held 2.791s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "cinder-quobyte-62ddb9f6-c38a-4336-b445-2d2777415004" released by "delete_snapshot" :: held 2.845s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:06 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Created reservations ['7b358c79-9694-407f-91ad-b4b69de2f2d2', '2aa6990d-6ccf-450b-9c04-8702ec946d2c', 'af678965-dde4-41c5-a211-e982b96685ad', '5dbdde17-e209-4078-966a-32978dcc7585'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:11:06 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Delete snapshot completed successfully.
Sep 25 15:11:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ef6d5d3f-b415-493e-b51c-97244c755ab8 tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "cinder-0ec2365f-d7e2-4a6e-aa64-056e0ea824d8-delete_snapshot" released by "delete_snapshot" :: held 3.189s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Acquiring lock "cinder-62ddb9f6-c38a-4336-b445-2d2777415004-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "cinder-62ddb9f6-c38a-4336-b445-2d2777415004-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Acquiring lock "cinder-quobyte-62ddb9f6-c38a-4336-b445-2d2777415004" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "cinder-quobyte-62ddb9f6-c38a-4336-b445-2d2777415004" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:07 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6f9b51-2417-4b15-a4af-f1a40aa77689]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:07 devstack sudo[100102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004
Sep 25 15:11:07 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:08 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004" returned: 0 in 0.742s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:08 devstack sudo[100108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004
Sep 25 15:11:08 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:08 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-62ddb9f6-c38a-4336-b445-2d2777415004" returned: 0 in 0.606s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "cinder-quobyte-62ddb9f6-c38a-4336-b445-2d2777415004" released by "delete_volume" :: held 1.478s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:08 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Created reservations ['afd45bbc-5142-48fa-9648-d3e142d4c300', 'f8fd304e-7685-40b3-a12b-2e605019c70b', '7945f580-e133-4f23-b937-f9c8ef89da2d', 'df3e16ff-93ae-4af6-b27c-602c54ad1578'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:11:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:09 devstack sudo[100111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:11:09 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:09 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.384s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:09 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:11:09 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Deleted volume successfully.
Sep 25 15:11:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c6d33e45-9180-4669-8aa1-973f73d15abf tempest-VolumesSnapshotNegativeTestJSON-1347362346 None] Lock "cinder-62ddb9f6-c38a-4336-b445-2d2777415004-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Flow 'volume_create_manager' (7063e5f9-b1ca-4744-9812-6995f5a7ca41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788bb3eb-73b7-4b97-b4b3-2a534ed24034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (788bb3eb-73b7-4b97-b4b3-2a534ed24034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1945151057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46bc67d8-d5df-4db4-91bd-dc2b90dfbc48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa66e252a7f406ebb8d2e27114c2d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:13Z,use_quota=True,user_id='5bf9e57eb2dc424484bb729aa4cc5977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b612bf-c9da-49b6-9ab5-dc9d446926eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b612bf-c9da-49b6-9ab5-dc9d446926eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9540f7bf-596f-45d0-8273-de9f935f3852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9540f7bf-596f-45d0-8273-de9f935f3852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46bc67d8-d5df-4db4-91bd-dc2b90dfbc48', 'volume_name': 'volume-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33722477-f639-42a9-89b7-414aefce6720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33722477-f639-42a9-89b7-414aefce6720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54512f63-ad9d-42b2-b7de-d90217c8d63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:12 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Volume 46bc67d8-d5df-4db4-91bd-dc2b90dfbc48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48', 'volume_size': 1}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1945151057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46bc67d8-d5df-4db4-91bd-dc2b90dfbc48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa66e252a7f406ebb8d2e27114c2d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:13Z,use_quota=True,user_id='5bf9e57eb2dc424484bb729aa4cc5977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Creating volume 46bc67d8-d5df-4db4-91bd-dc2b90dfbc48 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:11:12 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:11:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:12 devstack sudo[100116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48 1073741824
Sep 25 15:11:12 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:13 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:11:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Flow 'volume_create_manager' (0a49756f-99ef-4e66-bf03-11b57eabee78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607ec207-9401-449e-9256-e442ef604ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607ec207-9401-449e-9256-e442ef604ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-7820497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1735664-2efb-476b-9111-9902bfbe2968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e876ffeffdf74322afec135869d33171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:13Z,use_quota=True,user_id='9770aee3e6094b0f9c3bc97168896b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a2d428-5ea6-4b34-add5-cbb503284418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a2d428-5ea6-4b34-add5-cbb503284418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75dc4a3-2235-4c54-8444-0ea88d7c3602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75dc4a3-2235-4c54-8444-0ea88d7c3602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1735664-2efb-476b-9111-9902bfbe2968', 'volume_name': 'volume-b1735664-2efb-476b-9111-9902bfbe2968', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0762be7-b1e4-4f1a-a904-52baaf1c36c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0762be7-b1e4-4f1a-a904-52baaf1c36c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed59ec6d-72a1-4335-b4a5-e3ae7aa385df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:13 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Volume b1735664-2efb-476b-9111-9902bfbe2968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1735664-2efb-476b-9111-9902bfbe2968', 'volume_size': 1}
Sep 25 15:11:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:13 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48 1073741824" returned: 0 in 0.789s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:13 devstack sudo[100122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48
Sep 25 15:11:13 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:14 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48" returned: 0 in 0.420s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.624s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-7820497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1735664-2efb-476b-9111-9902bfbe2968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e876ffeffdf74322afec135869d33171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:13Z,use_quota=True,user_id='9770aee3e6094b0f9c3bc97168896b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Creating volume b1735664-2efb-476b-9111-9902bfbe2968 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:11:14 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54512f63-ad9d-42b2-b7de-d90217c8d63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac8cd96-e563-4838-9827-1c21151f0a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:14 devstack sudo[100125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968 1073741824
Sep 25 15:11:14 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:14 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Volume volume-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48 (46bc67d8-d5df-4db4-91bd-dc2b90dfbc48): created successfully
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac8cd96-e563-4838-9827-1c21151f0a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Flow 'volume_create_manager' (7063e5f9-b1ca-4744-9812-6995f5a7ca41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-786c505f-2d52-45fd-8ee4-6be328e91736 tempest-VolumesActionsTest-1345218368 None] Created volume successfully.
Sep 25 15:11:14 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968 1073741824" returned: 0 in 0.764s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:15 devstack sudo[100130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968
Sep 25 15:11:15 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Acquiring lock "cinder-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Lock "cinder-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Acquiring lock "cinder-quobyte-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Lock "cinder-quobyte-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48" acquired by "delete_volume" :: waited 0.040s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:15 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c697353a-9e0d-4fe6-92a8-c7ff29e3576c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:15 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968" returned: 0 in 0.544s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:11:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed59ec6d-72a1-4335-b4a5-e3ae7aa385df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1735664-2efb-476b-9111-9902bfbe2968', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02285e5d-2be7-4e0e-9821-91c76660880a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Volume volume-b1735664-2efb-476b-9111-9902bfbe2968 (b1735664-2efb-476b-9111-9902bfbe2968): created successfully
Sep 25 15:11:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02285e5d-2be7-4e0e-9821-91c76660880a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Flow 'volume_create_manager' (0a49756f-99ef-4e66-bf03-11b57eabee78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-15b8761f-15cd-44d3-aaaa-a1f4db2599d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Created volume successfully.
Sep 25 15:11:15 devstack sudo[100133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48
Sep 25 15:11:15 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:15 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Flow 'volume_create_manager' (c6fe4969-47e3-462f-9563-3b7e7139dfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d708a961-6a8b-454c-9fba-99b96391c8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d708a961-6a8b-454c-9fba-99b96391c8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-159168333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a003ae-6dba-4a33-b69b-6835354cb5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ceff665aa7e4e6395e924e19f6fdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:16Z,use_quota=True,user_id='1f2b104e94814d1ba3516c74b057574a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5209d1a6-9b51-46b5-b416-6e61ee5aada7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5209d1a6-9b51-46b5-b416-6e61ee5aada7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:16 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1637fc-baaf-49e0-ad96-20161843ad04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1637fc-baaf-49e0-ad96-20161843ad04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66a003ae-6dba-4a33-b69b-6835354cb5fe', 'volume_name': 'volume-66a003ae-6dba-4a33-b69b-6835354cb5fe', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc962ac-ce87-47c3-927e-d567c81173a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc962ac-ce87-47c3-927e-d567c81173a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30de68af-2543-4308-9835-6051d76e1d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume 66a003ae-6dba-4a33-b69b-6835354cb5fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66a003ae-6dba-4a33-b69b-6835354cb5fe', 'volume_size': 1}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-159168333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a003ae-6dba-4a33-b69b-6835354cb5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ceff665aa7e4e6395e924e19f6fdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:16Z,use_quota=True,user_id='1f2b104e94814d1ba3516c74b057574a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Creating volume 66a003ae-6dba-4a33-b69b-6835354cb5fe {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:11:16 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-66a003ae-6dba-4a33-b69b-6835354cb5fe 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48" returned: 0 in 0.657s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:16 devstack sudo[100139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-66a003ae-6dba-4a33-b69b-6835354cb5fe 1073741824
Sep 25 15:11:16 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:16 devstack sudo[100140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48
Sep 25 15:11:16 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:16 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48" returned: 0 in 0.427s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Lock "cinder-quobyte-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48" released by "delete_volume" :: held 1.186s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=116,cinder:SELECT=91,cinder:INSERT=29,cinder:DELETE=8 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Created reservations ['e88a3800-cf66-4c21-9f11-64e7b24a9e2f', '7f266e1a-5f46-4f83-ab38-bd1f8d601546', 'bdf9cbb7-b6b4-4551-b395-e2d7ef5413d7', '9d886164-ba7b-498a-8f15-ac391955631b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:16 devstack sudo[100148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:11:16 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:16 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-66a003ae-6dba-4a33-b69b-6835354cb5fe 1073741824" returned: 0 in 0.857s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-66a003ae-6dba-4a33-b69b-6835354cb5fe {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:17 devstack sudo[100150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-66a003ae-6dba-4a33-b69b-6835354cb5fe
Sep 25 15:11:17 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:17 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.404s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:17 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:11:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Deleted volume successfully.
Sep 25 15:11:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1ed496e-1a25-47e2-9268-90eff1bb429a tempest-VolumesActionsTest-779608173 None] Lock "cinder-46bc67d8-d5df-4db4-91bd-dc2b90dfbc48-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:17 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-66a003ae-6dba-4a33-b69b-6835354cb5fe" returned: 0 in 0.351s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:11:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.333s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30de68af-2543-4308-9835-6051d76e1d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66a003ae-6dba-4a33-b69b-6835354cb5fe', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18c13c8-36c5-426b-9d9d-35b1e5aa3338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Creating offline snapshot a40058f7-7d21-422a-b09c-7fb30ae342d8 of volume b1735664-2efb-476b-9111-9902bfbe2968 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:11:17 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume volume-66a003ae-6dba-4a33-b69b-6835354cb5fe (66a003ae-6dba-4a33-b69b-6835354cb5fe): created successfully
Sep 25 15:11:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18c13c8-36c5-426b-9d9d-35b1e5aa3338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Flow 'volume_create_manager' (c6fe4969-47e3-462f-9563-3b7e7139dfd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:17 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1a7dd0-b331-43be-8f60-07833cbba256]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6426bf43-cddb-4c64-8d91-9bc6cf959ea6 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Created volume successfully.
Sep 25 15:11:17 devstack sudo[100155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968
Sep 25 15:11:17 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:18 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968" returned: 0 in 0.663s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:18 devstack sudo[100162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8 1G
Sep 25 15:11:18 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:18 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:11:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Flow 'volume_create_manager' (fe03447c-dc5c-4255-9301-9086fb6ee8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91a2ca8-55a8-40b6-a037-c3a412cfee23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91a2ca8-55a8-40b6-a037-c3a412cfee23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1387538944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b277bf8b-bc5e-4f6a-a553-6b4c05af778e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa66e252a7f406ebb8d2e27114c2d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:18Z,use_quota=True,user_id='5bf9e57eb2dc424484bb729aa4cc5977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2118436b-53c3-48e1-93e7-2d77770c701d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2118436b-53c3-48e1-93e7-2d77770c701d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0230c59a-59f9-44f5-beba-f1e856e85b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0230c59a-59f9-44f5-beba-f1e856e85b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b277bf8b-bc5e-4f6a-a553-6b4c05af778e', 'volume_name': 'volume-b277bf8b-bc5e-4f6a-a553-6b4c05af778e', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7610888-a533-463e-9a9f-1a23ed259977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7610888-a533-463e-9a9f-1a23ed259977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5c654c-1290-4645-b39d-d4e40574a8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:18 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Volume b277bf8b-bc5e-4f6a-a553-6b4c05af778e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b277bf8b-bc5e-4f6a-a553-6b4c05af778e', 'volume_size': 1}
Sep 25 15:11:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:19 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8 1G" returned: 0 in 1.015s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1735664-2efb-476b-9111-9902bfbe2968 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:19 devstack sudo[100167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1735664-2efb-476b-9111-9902bfbe2968 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8
Sep 25 15:11:19 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Flow 'volume_create_manager' (aab2f669-ca19-4114-a69f-fdc320e21398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a247d3-0c37-4893-ad40-68993cd7942f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a247d3-0c37-4893-ad40-68993cd7942f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1020223067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39b1e67-57c2-4658-9171-b4da980b50b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ceff665aa7e4e6395e924e19f6fdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:19Z,use_quota=True,user_id='1f2b104e94814d1ba3516c74b057574a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab5f19a-e721-4555-a990-d068ed12012f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab5f19a-e721-4555-a990-d068ed12012f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8ded52-0500-47a9-bffc-746fa216651a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8ded52-0500-47a9-bffc-746fa216651a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b39b1e67-57c2-4658-9171-b4da980b50b9', 'volume_name': 'volume-b39b1e67-57c2-4658-9171-b4da980b50b9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf4916c-1b17-4532-806e-44167be0fab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf4916c-1b17-4532-806e-44167be0fab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39ece2f-22ea-4975-a7c2-0a1e49a1d55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:19 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume b39b1e67-57c2-4658-9171-b4da980b50b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b39b1e67-57c2-4658-9171-b4da980b50b9', 'volume_size': 1}
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:19 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1735664-2efb-476b-9111-9902bfbe2968 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8" returned: 0 in 0.559s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:19 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8 is being set with open permissions: ugo+rw
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:19 devstack sudo[100172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8
Sep 25 15:11:19 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Flow 'volume_create_manager' (04fb6471-d0fd-41b4-b57f-5123e9c664ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad0ac31-54c4-43ea-b037-9598386d1eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad0ac31-54c4-43ea-b037-9598386d1eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-575854371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf167370-8da2-4289-9e6a-1cda3dd97d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ceff665aa7e4e6395e924e19f6fdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:20Z,use_quota=True,user_id='1f2b104e94814d1ba3516c74b057574a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f57afe9-90f9-4acd-858b-d315504b8f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f57afe9-90f9-4acd-858b-d315504b8f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e566534f-f24b-40ef-a2ef-4b8844b4c9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e566534f-f24b-40ef-a2ef-4b8844b4c9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf167370-8da2-4289-9e6a-1cda3dd97d5a', 'volume_name': 'volume-cf167370-8da2-4289-9e6a-1cda3dd97d5a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56405bb1-4ae9-494a-9ea4-34581bfd3ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56405bb1-4ae9-494a-9ea4-34581bfd3ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2305c49-6182-49e5-9776-26dc9ac60e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:20 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume cf167370-8da2-4289-9e6a-1cda3dd97d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf167370-8da2-4289-9e6a-1cda3dd97d5a', 'volume_size': 1}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:20 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8" returned: 0 in 0.416s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:20 devstack sudo[100175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.info
Sep 25 15:11:20 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Flow 'volume_create_manager' (e257fa54-07f5-455e-a62e-2dde569ba31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf917f8-6f67-4e8a-884e-87410c273829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf917f8-6f67-4e8a-884e-87410c273829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-45838620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df143ce7-8d07-4965-aa3c-41eaae1ab2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ceff665aa7e4e6395e924e19f6fdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:20Z,use_quota=True,user_id='1f2b104e94814d1ba3516c74b057574a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd186f6f-bb81-4a27-bf31-309c6e5023ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd186f6f-bb81-4a27-bf31-309c6e5023ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e069a1-613e-40c7-b5a2-d6bebaec6644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e069a1-613e-40c7-b5a2-d6bebaec6644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df143ce7-8d07-4965-aa3c-41eaae1ab2a2', 'volume_name': 'volume-df143ce7-8d07-4965-aa3c-41eaae1ab2a2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2e24fc-3fd4-4683-a577-027b2f26a551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2e24fc-3fd4-4683-a577-027b2f26a551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71110501-5aa3-4753-b6c7-92530d1bc841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:20 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume df143ce7-8d07-4965-aa3c-41eaae1ab2a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df143ce7-8d07-4965-aa3c-41eaae1ab2a2', 'volume_size': 1}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:20 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.info" returned: 0 in 0.486s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:20 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.info is being set with open permissions: ugo+rw
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:20 devstack sudo[100178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.info
Sep 25 15:11:20 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:20 devstack sudo[100180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:11:20 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:21 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.info" returned: 0 in 0.371s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.691s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.266s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1387538944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b277bf8b-bc5e-4f6a-a553-6b4c05af778e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa66e252a7f406ebb8d2e27114c2d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:18Z,use_quota=True,user_id='5bf9e57eb2dc424484bb729aa4cc5977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Creating volume b277bf8b-bc5e-4f6a-a553-6b4c05af778e {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:11:21 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b277bf8b-bc5e-4f6a-a553-6b4c05af778e 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:21 devstack sudo[100183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b277bf8b-bc5e-4f6a-a553-6b4c05af778e 1073741824
Sep 25 15:11:21 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Flow 'volume_create_manager' (d7430976-4bb3-43a5-960d-bae2b7ebbc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef307ad-ec07-4f6e-82c9-b5b7d3c088f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e9509310-4f4a-46c2-8e78-f7f7b32c480f tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Create snapshot completed successfully
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef307ad-ec07-4f6e-82c9-b5b7d3c088f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1937910327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed20db1-e7c2-4de0-883d-d632009a0695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ceff665aa7e4e6395e924e19f6fdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:21Z,use_quota=True,user_id='1f2b104e94814d1ba3516c74b057574a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44a3827-6c40-445b-aff5-f0898549b21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44a3827-6c40-445b-aff5-f0898549b21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2ea182-d80e-4f6a-a1c1-620538f78601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2ea182-d80e-4f6a-a1c1-620538f78601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed20db1-e7c2-4de0-883d-d632009a0695', 'volume_name': 'volume-9ed20db1-e7c2-4de0-883d-d632009a0695', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fedad672-bbd6-43ab-98ec-2b622f1d494b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fedad672-bbd6-43ab-98ec-2b622f1d494b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee7bfc3-1f8c-46ac-b31b-f81b2333df00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:21 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume 9ed20db1-e7c2-4de0-883d-d632009a0695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed20db1-e7c2-4de0-883d-d632009a0695', 'volume_size': 1}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:21 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.599s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Flow 'volume_create_manager' (22736ce1-013f-478a-8727-f289ed7c52f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cd33bb-7ffb-4820-b367-a453dc75b7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cd33bb-7ffb-4820-b367-a453dc75b7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-511408973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa4a351-96d1-41f1-8a7c-0cac76b1cf72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ceff665aa7e4e6395e924e19f6fdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:22Z,use_quota=True,user_id='1f2b104e94814d1ba3516c74b057574a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013b0fcb-e9c5-478f-b58a-74d135280cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013b0fcb-e9c5-478f-b58a-74d135280cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d2416d-a3e4-448e-92fb-82857eb4f578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d2416d-a3e4-448e-92fb-82857eb4f578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fa4a351-96d1-41f1-8a7c-0cac76b1cf72', 'volume_name': 'volume-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5ff525-476a-45c7-9fd5-ac74bb870afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5ff525-476a-45c7-9fd5-ac74bb870afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:22 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b77324e-c0cc-4172-aa8c-ff91a5fc1a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:22 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume 1fa4a351-96d1-41f1-8a7c-0cac76b1cf72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72', 'volume_size': 1}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b277bf8b-bc5e-4f6a-a553-6b4c05af778e 1073741824" returned: 0 in 0.960s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b277bf8b-bc5e-4f6a-a553-6b4c05af778e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:22 devstack sudo[100190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b277bf8b-bc5e-4f6a-a553-6b4c05af778e
Sep 25 15:11:22 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Acquiring lock "cinder-a40058f7-7d21-422a-b09c-7fb30ae342d8-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "cinder-a40058f7-7d21-422a-b09c-7fb30ae342d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Acquiring lock "cinder-quobyte-b1735664-2efb-476b-9111-9902bfbe2968" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "cinder-quobyte-b1735664-2efb-476b-9111-9902bfbe2968" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Acquiring lock "cinder-quobyte-a40058f7-7d21-422a-b09c-7fb30ae342d8" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "cinder-quobyte-a40058f7-7d21-422a-b09c-7fb30ae342d8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Deleting offline snapshot a40058f7-7d21-422a-b09c-7fb30ae342d8 of volume b1735664-2efb-476b-9111-9902bfbe2968 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] snapshot_file for this snap is: volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1ae3f7-363d-462b-9dbb-c83f4878bfdb]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:22 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b277bf8b-bc5e-4f6a-a553-6b4c05af778e" returned: 0 in 0.413s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.070s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1020223067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39b1e67-57c2-4658-9171-b4da980b50b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ceff665aa7e4e6395e924e19f6fdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:19Z,use_quota=True,user_id='1f2b104e94814d1ba3516c74b057574a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Creating volume b39b1e67-57c2-4658-9171-b4da980b50b9 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:11:22 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b39b1e67-57c2-4658-9171-b4da980b50b9 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5c654c-1290-4645-b39d-d4e40574a8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b277bf8b-bc5e-4f6a-a553-6b4c05af778e', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2619a1-29f6-4fe9-b14c-5f578d2d2bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:22 devstack sudo[100194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b39b1e67-57c2-4658-9171-b4da980b50b9 1073741824
Sep 25 15:11:22 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:22 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Volume volume-b277bf8b-bc5e-4f6a-a553-6b4c05af778e (b277bf8b-bc5e-4f6a-a553-6b4c05af778e): created successfully
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2619a1-29f6-4fe9-b14c-5f578d2d2bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:22 devstack sudo[100193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8
Sep 25 15:11:22 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Flow 'volume_create_manager' (fe03447c-dc5c-4255-9301-9086fb6ee8dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:22 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c14e53a0-acf6-4a6b-af53-1cffa9396d18 tempest-VolumesActionsTest-1345218368 None] Created volume successfully.
Sep 25 15:11:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Acquiring lock "cinder-b277bf8b-bc5e-4f6a-a553-6b4c05af778e-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Lock "cinder-b277bf8b-bc5e-4f6a-a553-6b4c05af778e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:23 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8" returned: 0 in 0.680s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1735664-2efb-476b-9111-9902bfbe2968(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:11:23 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b3cdda-fb87-443f-8c19-c370f2ad0f1b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Acquiring lock "cinder-quobyte-b277bf8b-bc5e-4f6a-a553-6b4c05af778e" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Lock "cinder-quobyte-b277bf8b-bc5e-4f6a-a553-6b4c05af778e" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:23 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[75042491-ea7a-446d-a2b4-bccd836afb27]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b277bf8b-bc5e-4f6a-a553-6b4c05af778e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:23 devstack sudo[100203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968
Sep 25 15:11:23 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:23 devstack sudo[100204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b277bf8b-bc5e-4f6a-a553-6b4c05af778e
Sep 25 15:11:23 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:23 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b39b1e67-57c2-4658-9171-b4da980b50b9 1073741824" returned: 0 in 0.997s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b39b1e67-57c2-4658-9171-b4da980b50b9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:23 devstack sudo[100208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b39b1e67-57c2-4658-9171-b4da980b50b9
Sep 25 15:11:23 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:23 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968" returned: 0 in 0.617s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:23 devstack sudo[100216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8
Sep 25 15:11:23 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:23 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b277bf8b-bc5e-4f6a-a553-6b4c05af778e" returned: 0 in 0.582s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b277bf8b-bc5e-4f6a-a553-6b4c05af778e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:23 devstack sudo[100218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b277bf8b-bc5e-4f6a-a553-6b4c05af778e
Sep 25 15:11:23 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:24 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b39b1e67-57c2-4658-9171-b4da980b50b9" returned: 0 in 0.396s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-575854371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf167370-8da2-4289-9e6a-1cda3dd97d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ceff665aa7e4e6395e924e19f6fdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:20Z,use_quota=True,user_id='1f2b104e94814d1ba3516c74b057574a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Creating volume cf167370-8da2-4289-9e6a-1cda3dd97d5a {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:11:24 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-cf167370-8da2-4289-9e6a-1cda3dd97d5a 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39ece2f-22ea-4975-a7c2-0a1e49a1d55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b39b1e67-57c2-4658-9171-b4da980b50b9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:24 devstack sudo[100221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-cf167370-8da2-4289-9e6a-1cda3dd97d5a 1073741824
Sep 25 15:11:24 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb073a56-3258-46c6-9873-432b0b04c569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:24 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume volume-b39b1e67-57c2-4658-9171-b4da980b50b9 (b39b1e67-57c2-4658-9171-b4da980b50b9): created successfully
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb073a56-3258-46c6-9873-432b0b04c569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Flow 'volume_create_manager' (aab2f669-ca19-4114-a69f-fdc320e21398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ffe766fd-e5ab-41b0-8e7b-060b1dad2d14 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Created volume successfully.
Sep 25 15:11:24 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b277bf8b-bc5e-4f6a-a553-6b4c05af778e" returned: 0 in 0.444s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Lock "cinder-quobyte-b277bf8b-bc5e-4f6a-a553-6b4c05af778e" released by "delete_volume" :: held 1.098s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:24 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8" returned: 0 in 0.619s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Created reservations ['3068afae-1b3e-4128-ac4c-7786e3643e80', 'c07f4784-48c9-4bf7-85ae-d5279b14f4f0', '3dc7223f-3deb-4e40-92f5-b3660d83f2c9', '031f38f1-2e15-476c-a629-fe61d4617a06'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:11:24 devstack sudo[100229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8
Sep 25 15:11:24 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:24 devstack sudo[100233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:11:24 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:24 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968.a40058f7-7d21-422a-b09c-7fb30ae342d8" returned: 0 in 0.457s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:25 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-cf167370-8da2-4289-9e6a-1cda3dd97d5a 1073741824" returned: 0 in 0.903s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "cinder-quobyte-a40058f7-7d21-422a-b09c-7fb30ae342d8" released by "_delete_snapshot" :: held 2.610s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "cinder-quobyte-b1735664-2efb-476b-9111-9902bfbe2968" released by "delete_snapshot" :: held 2.654s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-cf167370-8da2-4289-9e6a-1cda3dd97d5a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:25 devstack sudo[100237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-cf167370-8da2-4289-9e6a-1cda3dd97d5a
Sep 25 15:11:25 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:25 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.472s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:11:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Deleted volume successfully.
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-60890459-444a-4f8f-a2a4-65f2a06dd4da tempest-VolumesActionsTest-779608173 None] Lock "cinder-b277bf8b-bc5e-4f6a-a553-6b4c05af778e-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Created reservations ['a137df77-b340-4f88-b9dd-b50a98457507', '9187131f-9f72-4552-8256-2c0a5a6d06c5', 'ebeda2d1-47e8-41bb-bbbe-b0ba324189c5', 'f4b55765-1f79-4e64-87a4-00baaf6490c0'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:11:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Delete snapshot completed successfully.
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-866e30b8-8e63-4424-9967-463088bab09c tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "cinder-a40058f7-7d21-422a-b09c-7fb30ae342d8-delete_snapshot" released by "delete_snapshot" :: held 2.904s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:25 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-cf167370-8da2-4289-9e6a-1cda3dd97d5a" returned: 0 in 0.386s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.913s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-45838620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df143ce7-8d07-4965-aa3c-41eaae1ab2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ceff665aa7e4e6395e924e19f6fdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:20Z,use_quota=True,user_id='1f2b104e94814d1ba3516c74b057574a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Creating volume df143ce7-8d07-4965-aa3c-41eaae1ab2a2 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:11:25 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-df143ce7-8d07-4965-aa3c-41eaae1ab2a2 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2305c49-6182-49e5-9776-26dc9ac60e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf167370-8da2-4289-9e6a-1cda3dd97d5a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:25 devstack sudo[100240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-df143ce7-8d07-4965-aa3c-41eaae1ab2a2 1073741824
Sep 25 15:11:25 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee982b23-f8ad-4d37-a700-7482fb9cc601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:25 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume volume-cf167370-8da2-4289-9e6a-1cda3dd97d5a (cf167370-8da2-4289-9e6a-1cda3dd97d5a): created successfully
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee982b23-f8ad-4d37-a700-7482fb9cc601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Flow 'volume_create_manager' (04fb6471-d0fd-41b4-b57f-5123e9c664ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c6458d59-18c9-4c24-9790-0dc055374939 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Created volume successfully.
Sep 25 15:11:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Acquiring lock "cinder-b1735664-2efb-476b-9111-9902bfbe2968-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "cinder-b1735664-2efb-476b-9111-9902bfbe2968-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Acquiring lock "cinder-quobyte-b1735664-2efb-476b-9111-9902bfbe2968" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "cinder-quobyte-b1735664-2efb-476b-9111-9902bfbe2968" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc060c43-31bd-482b-8d17-c0e67061bbd7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:26 devstack sudo[100245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968
Sep 25 15:11:26 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:26 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-df143ce7-8d07-4965-aa3c-41eaae1ab2a2 1073741824" returned: 0 in 0.950s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-df143ce7-8d07-4965-aa3c-41eaae1ab2a2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:26 devstack sudo[100248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-df143ce7-8d07-4965-aa3c-41eaae1ab2a2
Sep 25 15:11:26 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Flow 'volume_create_manager' (f2f2f23c-6aa1-4d10-b803-cfa09baba5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a28a25-e14f-4d53-9fa5-689a59c15c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a28a25-e14f-4d53-9fa5-689a59c15c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-917169548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98a2101d-bcf1-4256-9c53-c4d6eea6a399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa66e252a7f406ebb8d2e27114c2d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:27Z,use_quota=True,user_id='5bf9e57eb2dc424484bb729aa4cc5977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f05facf-6ce6-4b1b-9dd1-5a04441c73aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f05facf-6ce6-4b1b-9dd1-5a04441c73aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae0135c-9aa1-4b15-a081-c452b4be4036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae0135c-9aa1-4b15-a081-c452b4be4036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98a2101d-bcf1-4256-9c53-c4d6eea6a399', 'volume_name': 'volume-98a2101d-bcf1-4256-9c53-c4d6eea6a399', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04415c04-2acf-45cd-8cd9-54ab8f6b0cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:26 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04415c04-2acf-45cd-8cd9-54ab8f6b0cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f0cc21-90b5-4cc2-a2b5-281a5cfc16c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:26 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Volume 98a2101d-bcf1-4256-9c53-c4d6eea6a399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98a2101d-bcf1-4256-9c53-c4d6eea6a399', 'volume_size': 1}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968" returned: 0 in 0.717s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:27 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-df143ce7-8d07-4965-aa3c-41eaae1ab2a2" returned: 0 in 0.420s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:27 devstack sudo[100254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968
Sep 25 15:11:27 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.599s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1937910327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed20db1-e7c2-4de0-883d-d632009a0695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ceff665aa7e4e6395e924e19f6fdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:21Z,use_quota=True,user_id='1f2b104e94814d1ba3516c74b057574a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Creating volume 9ed20db1-e7c2-4de0-883d-d632009a0695 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:11:27 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9ed20db1-e7c2-4de0-883d-d632009a0695 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71110501-5aa3-4753-b6c7-92530d1bc841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df143ce7-8d07-4965-aa3c-41eaae1ab2a2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:27 devstack sudo[100256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9ed20db1-e7c2-4de0-883d-d632009a0695 1073741824
Sep 25 15:11:27 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43320059-648d-4975-920e-b729ed83f147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:27 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume volume-df143ce7-8d07-4965-aa3c-41eaae1ab2a2 (df143ce7-8d07-4965-aa3c-41eaae1ab2a2): created successfully
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43320059-648d-4975-920e-b729ed83f147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Flow 'volume_create_manager' (e257fa54-07f5-455e-a62e-2dde569ba31a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-566f93cc-7dba-416d-bc77-d5d24387b3ca tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Created volume successfully.
Sep 25 15:11:27 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b1735664-2efb-476b-9111-9902bfbe2968" returned: 0 in 0.360s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "cinder-quobyte-b1735664-2efb-476b-9111-9902bfbe2968" released by "delete_volume" :: held 1.206s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Created reservations ['3425537e-d403-462e-b390-7b3194e3db57', '37493d2c-55ca-48cf-8ebe-3c9edf540ec9', '360c392d-15d6-4697-b80b-cc5e6c4df681', 'bfcc0a68-48d9-48df-8e47-9b12326c72d2'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:27 devstack sudo[100264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:11:27 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:27 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9ed20db1-e7c2-4de0-883d-d632009a0695 1073741824" returned: 0 in 0.782s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9ed20db1-e7c2-4de0-883d-d632009a0695 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:27 devstack sudo[100267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9ed20db1-e7c2-4de0-883d-d632009a0695
Sep 25 15:11:27 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:27 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.326s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:11:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Deleted volume successfully.
Sep 25 15:11:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-48549c6b-2d15-42d6-85c8-12bf8435fdfe tempest-VolumeSnapshotQuotasNegativeTestJSON-114726761 None] Lock "cinder-b1735664-2efb-476b-9111-9902bfbe2968-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:28 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9ed20db1-e7c2-4de0-883d-d632009a0695" returned: 0 in 0.437s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.232s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-511408973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa4a351-96d1-41f1-8a7c-0cac76b1cf72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ceff665aa7e4e6395e924e19f6fdbe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:22Z,use_quota=True,user_id='1f2b104e94814d1ba3516c74b057574a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Creating volume 1fa4a351-96d1-41f1-8a7c-0cac76b1cf72 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:11:28 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee7bfc3-1f8c-46ac-b31b-f81b2333df00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed20db1-e7c2-4de0-883d-d632009a0695', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12146685-950e-4c3f-a491-6b5e305fdb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:28 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume volume-9ed20db1-e7c2-4de0-883d-d632009a0695 (9ed20db1-e7c2-4de0-883d-d632009a0695): created successfully
Sep 25 15:11:28 devstack sudo[100270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72 1073741824
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12146685-950e-4c3f-a491-6b5e305fdb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:28 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Flow 'volume_create_manager' (d7430976-4bb3-43a5-960d-bae2b7ebbc09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-610dfbd5-238f-4c6b-ab02-51b6de237eef tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Created volume successfully.
Sep 25 15:11:29 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72 1073741824" returned: 0 in 0.686s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:29 devstack sudo[100275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72
Sep 25 15:11:29 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:29 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72" returned: 0 in 0.384s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.535s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-917169548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98a2101d-bcf1-4256-9c53-c4d6eea6a399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa66e252a7f406ebb8d2e27114c2d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:27Z,use_quota=True,user_id='5bf9e57eb2dc424484bb729aa4cc5977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Creating volume 98a2101d-bcf1-4256-9c53-c4d6eea6a399 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:11:29 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-98a2101d-bcf1-4256-9c53-c4d6eea6a399 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b77324e-c0cc-4172-aa8c-ff91a5fc1a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02cae979-6eae-43ce-813e-67d32671ccec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:29 devstack sudo[100278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-98a2101d-bcf1-4256-9c53-c4d6eea6a399 1073741824
Sep 25 15:11:29 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:29 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Volume volume-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72 (1fa4a351-96d1-41f1-8a7c-0cac76b1cf72): created successfully
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02cae979-6eae-43ce-813e-67d32671ccec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Flow 'volume_create_manager' (22736ce1-013f-478a-8727-f289ed7c52f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b2452672-f201-49b8-9e41-c82606653a71 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Created volume successfully.
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Flow 'volume_create_manager' (b55d152b-c8a7-4bed-957a-60bf2c00f5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed1fc73-531c-4d7f-b597-0d68b1bcc830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed1fc73-531c-4d7f-b597-0d68b1bcc830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1080271166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a610a5b-30ed-4c3a-82b7-05a8e89bcc03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02997a3926c4a18bcba6cd31e657d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:30Z,use_quota=True,user_id='d99ff94a210147d3ae1459d60c567304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d5a141-bd36-4847-8a37-6c686170e07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d5a141-bd36-4847-8a37-6c686170e07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e21146-af1f-4426-9a32-21d58399983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e21146-af1f-4426-9a32-21d58399983c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a610a5b-30ed-4c3a-82b7-05a8e89bcc03', 'volume_name': 'volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ad152b-b631-487c-89cd-5c1b70ce658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ad152b-b631-487c-89cd-5c1b70ce658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7c45de-f11e-4bfc-a02e-c3e4d997a1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:29 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Volume 4a610a5b-30ed-4c3a-82b7-05a8e89bcc03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03', 'volume_size': 1}
Sep 25 15:11:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:30 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-98a2101d-bcf1-4256-9c53-c4d6eea6a399 1073741824" returned: 0 in 0.599s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "cinder-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-98a2101d-bcf1-4256-9c53-c4d6eea6a399 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:30 devstack sudo[100284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-98a2101d-bcf1-4256-9c53-c4d6eea6a399
Sep 25 15:11:30 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "cinder-quobyte-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-quobyte-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae53420e-abe9-4007-88c0-95aaddbcebdb]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:30 devstack sudo[100286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72
Sep 25 15:11:30 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:30 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-98a2101d-bcf1-4256-9c53-c4d6eea6a399" returned: 0 in 0.316s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.761s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1080271166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a610a5b-30ed-4c3a-82b7-05a8e89bcc03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02997a3926c4a18bcba6cd31e657d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:30Z,use_quota=True,user_id='d99ff94a210147d3ae1459d60c567304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Creating volume 4a610a5b-30ed-4c3a-82b7-05a8e89bcc03 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:11:30 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:30 devstack sudo[100289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03 1073741824
Sep 25 15:11:30 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f0cc21-90b5-4cc2-a2b5-281a5cfc16c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98a2101d-bcf1-4256-9c53-c4d6eea6a399', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9478ac08-f579-4d54-9670-223b9157728b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:30 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Volume volume-98a2101d-bcf1-4256-9c53-c4d6eea6a399 (98a2101d-bcf1-4256-9c53-c4d6eea6a399): created successfully
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9478ac08-f579-4d54-9670-223b9157728b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Flow 'volume_create_manager' (f2f2f23c-6aa1-4d10-b803-cfa09baba5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a54357d9-7cd8-424d-9204-bb19f3b801f2 tempest-VolumesActionsTest-1345218368 None] Created volume successfully.
Sep 25 15:11:30 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72" returned: 0 in 0.632s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:30 devstack sudo[100296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72
Sep 25 15:11:30 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:31 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03 1073741824" returned: 0 in 0.813s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:31 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Acquiring lock "cinder-98a2101d-bcf1-4256-9c53-c4d6eea6a399-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72" returned: 0 in 0.459s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Lock "cinder-98a2101d-bcf1-4256-9c53-c4d6eea6a399-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-quobyte-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72" released by "delete_volume" :: held 1.166s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:31 devstack sudo[100301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03
Sep 25 15:11:31 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Acquiring lock "cinder-quobyte-98a2101d-bcf1-4256-9c53-c4d6eea6a399" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Lock "cinder-quobyte-98a2101d-bcf1-4256-9c53-c4d6eea6a399" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Created reservations ['a2c4dcbd-3b01-4eab-8521-9135f233d5f7', '20beb31d-4cf8-4059-b929-e96c1f6155b4', '431b4c6f-3b6f-4902-8297-8b9ca20bea3b', '7b9fac75-5b12-4b44-b23e-0c2a71baee52'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf45b6a-098c-4e72-b2c7-42e0f6994b5f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-98a2101d-bcf1-4256-9c53-c4d6eea6a399 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:31 devstack sudo[100303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-98a2101d-bcf1-4256-9c53-c4d6eea6a399
Sep 25 15:11:31 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:31 devstack sudo[100304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:11:31 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:31 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03" returned: 0 in 0.451s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7c45de-f11e-4bfc-a02e-c3e4d997a1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e03767-b5cf-4e68-8e2c-380391d80203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:31 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Volume volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03 (4a610a5b-30ed-4c3a-82b7-05a8e89bcc03): created successfully
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e03767-b5cf-4e68-8e2c-380391d80203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Flow 'volume_create_manager' (b55d152b-c8a7-4bed-957a-60bf2c00f5da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-763fd6b7-6856-4ed8-b4f2-7bf4b96f5d09 tempest-TestImageHashVerification-1725106439 None] Created volume successfully.
Sep 25 15:11:32 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-98a2101d-bcf1-4256-9c53-c4d6eea6a399" returned: 0 in 0.571s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-98a2101d-bcf1-4256-9c53-c4d6eea6a399 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:32 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.440s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:11:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Deleted volume successfully.
Sep 25 15:11:32 devstack sudo[100312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-98a2101d-bcf1-4256-9c53-c4d6eea6a399
Sep 25 15:11:32 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-84467fb6-6f58-4756-829d-4c51ec1a7ee9 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-1fa4a351-96d1-41f1-8a7c-0cac76b1cf72-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "cinder-9ed20db1-e7c2-4de0-883d-d632009a0695-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:32 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-98a2101d-bcf1-4256-9c53-c4d6eea6a399" returned: 0 in 0.332s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Lock "cinder-quobyte-98a2101d-bcf1-4256-9c53-c4d6eea6a399" released by "delete_volume" :: held 1.023s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-9ed20db1-e7c2-4de0-883d-d632009a0695-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "cinder-quobyte-9ed20db1-e7c2-4de0-883d-d632009a0695" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-quobyte-9ed20db1-e7c2-4de0-883d-d632009a0695" acquired by "delete_volume" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Created reservations ['5f572213-be2a-4fff-a39d-db39c360b139', '582c14ea-f5c7-4714-b90f-3cb56de78578', 'e194c2dd-4b48-4685-9b54-7345ce1073ea', '9c3ab70c-0dba-4026-ac42-9f42831d5d77'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8ad1a7-6b06-4121-b4a1-46a1a4b3dde0]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9ed20db1-e7c2-4de0-883d-d632009a0695 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:32 devstack sudo[100316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:11:32 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:32 devstack sudo[100315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9ed20db1-e7c2-4de0-883d-d632009a0695
Sep 25 15:11:32 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:33 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.451s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:33 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:11:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Deleted volume successfully.
Sep 25 15:11:33 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9ed20db1-e7c2-4de0-883d-d632009a0695" returned: 0 in 0.613s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9ed20db1-e7c2-4de0-883d-d632009a0695 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:33 devstack sudo[100323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9ed20db1-e7c2-4de0-883d-d632009a0695
Sep 25 15:11:33 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d66c8bf-9617-41d7-9a17-2a058a8bbb5f tempest-VolumesActionsTest-779608173 None] Lock "cinder-98a2101d-bcf1-4256-9c53-c4d6eea6a399-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:33 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9ed20db1-e7c2-4de0-883d-d632009a0695" returned: 0 in 0.407s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-quobyte-9ed20db1-e7c2-4de0-883d-d632009a0695" released by "delete_volume" :: held 1.097s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:33 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Created reservations ['f406f3f5-c27e-440c-874b-66490cd9fede', 'ac47e305-019e-4e10-8b0d-728777cefb3d', 'e4845abc-a829-4ab1-ab4d-f1658529b30e', '51a5ede4-e61f-4333-b2eb-d895c5381a23'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:34 devstack sudo[100326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:11:34 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:34 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.575s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:11:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Deleted volume successfully.
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Flow 'volume_create_manager' (e86d6713-dcc6-4290-abea-a3cf3889ceb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9639b076-a3e7-4a8c-9166-ff518673dc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-79f23032-cdad-4760-969e-ff3b0106d0d4 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-9ed20db1-e7c2-4de0-883d-d632009a0695-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e5bdfd09-21dd-4a81-b83e-2d08beb7a7e6 tempest-TestImageHashVerification-1725106439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e5bdfd09-21dd-4a81-b83e-2d08beb7a7e6 tempest-TestImageHashVerification-1725106439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9639b076-a3e7-4a8c-9166-ff518673dc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1254742173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd37558-3b97-4054-8211-c8710a3010ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa66e252a7f406ebb8d2e27114c2d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:35Z,use_quota=True,user_id='5bf9e57eb2dc424484bb729aa4cc5977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fd99fc-4c16-42f7-ad74-f31d12aefbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fd99fc-4c16-42f7-ad74-f31d12aefbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e12255-1931-43ed-af7c-2192a094894f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e12255-1931-43ed-af7c-2192a094894f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdd37558-3b97-4054-8211-c8710a3010ab', 'volume_name': 'volume-bdd37558-3b97-4054-8211-c8710a3010ab', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30198b33-6ebe-4be4-aa30-6c8e7ce98383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30198b33-6ebe-4be4-aa30-6c8e7ce98383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c87885-d173-4f18-9164-1dbc2b6ca51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:34 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Volume bdd37558-3b97-4054-8211-c8710a3010ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdd37558-3b97-4054-8211-c8710a3010ab', 'volume_size': 1}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[183c19d8-5b63-4ae9-9784-4084bef8326a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e5bdfd09-21dd-4a81-b83e-2d08beb7a7e6 tempest-TestImageHashVerification-1725106439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "cinder-df143ce7-8d07-4965-aa3c-41eaae1ab2a2-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-df143ce7-8d07-4965-aa3c-41eaae1ab2a2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "cinder-quobyte-df143ce7-8d07-4965-aa3c-41eaae1ab2a2" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-quobyte-df143ce7-8d07-4965-aa3c-41eaae1ab2a2" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:35 devstack sudo[100330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03
Sep 25 15:11:35 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:35 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6b6c67-760f-42dd-9cf2-3d5a5d9acf36]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-df143ce7-8d07-4965-aa3c-41eaae1ab2a2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:35 devstack sudo[100332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-df143ce7-8d07-4965-aa3c-41eaae1ab2a2
Sep 25 15:11:35 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:35 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e5bdfd09-21dd-4a81-b83e-2d08beb7a7e6 tempest-TestImageHashVerification-1725106439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03" returned: 0 in 0.494s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:35 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[541e2a7c-8309-42f6-bed6-4822eed72899]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e5bdfd09-21dd-4a81-b83e-2d08beb7a7e6 tempest-TestImageHashVerification-1725106439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:35 devstack sudo[100337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03
Sep 25 15:11:35 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:35 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-df143ce7-8d07-4965-aa3c-41eaae1ab2a2" returned: 0 in 0.547s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-df143ce7-8d07-4965-aa3c-41eaae1ab2a2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:35 devstack sudo[100342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-df143ce7-8d07-4965-aa3c-41eaae1ab2a2
Sep 25 15:11:35 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:35 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e5bdfd09-21dd-4a81-b83e-2d08beb7a7e6 tempest-TestImageHashVerification-1725106439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03" returned: 0 in 0.549s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e5bdfd09-21dd-4a81-b83e-2d08beb7a7e6 tempest-TestImageHashVerification-1725106439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03 /opt/stack/data/cinder/conversion/4a610a5b-30ed-4c3a-82b7-05a8e89bcc03.temp_image.55b353b2-6d94-4ad8-bd9e-a38bd43691fdur_hyx0i.img {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:35 devstack sudo[100349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03 /opt/stack/data/cinder/conversion/4a610a5b-30ed-4c3a-82b7-05a8e89bcc03.temp_image.55b353b2-6d94-4ad8-bd9e-a38bd43691fdur_hyx0i.img
Sep 25 15:11:35 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:35 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-df143ce7-8d07-4965-aa3c-41eaae1ab2a2" returned: 0 in 0.368s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-quobyte-df143ce7-8d07-4965-aa3c-41eaae1ab2a2" released by "delete_volume" :: held 1.011s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:36 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Created reservations ['f4dd9318-0b50-433f-8999-637710238fdc', '317ca144-78d8-4656-8353-0d422133b588', '653d6d50-a7f2-43c7-a216-cd602ce8ad89', 'c59a284e-3134-47d4-b66b-e8bcfb3eaa51'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:11:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:36 devstack sudo[100351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:11:36 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:36 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.486s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:36 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:11:36 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Deleted volume successfully.
Sep 25 15:11:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1d097871-8be8-4e66-a1eb-32d115bfd964 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-df143ce7-8d07-4965-aa3c-41eaae1ab2a2-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "cinder-cf167370-8da2-4289-9e6a-1cda3dd97d5a-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-cf167370-8da2-4289-9e6a-1cda3dd97d5a-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "cinder-quobyte-cf167370-8da2-4289-9e6a-1cda3dd97d5a" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-quobyte-cf167370-8da2-4289-9e6a-1cda3dd97d5a" acquired by "delete_volume" :: waited 0.052s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:37 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbd01b2-bf9f-49e5-9354-e34296239ac5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-cf167370-8da2-4289-9e6a-1cda3dd97d5a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:38 devstack sudo[100365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-cf167370-8da2-4289-9e6a-1cda3dd97d5a
Sep 25 15:11:38 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:38 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-cf167370-8da2-4289-9e6a-1cda3dd97d5a" returned: 0 in 1.042s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-cf167370-8da2-4289-9e6a-1cda3dd97d5a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:38 devstack sudo[100370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-cf167370-8da2-4289-9e6a-1cda3dd97d5a
Sep 25 15:11:38 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:39 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-cf167370-8da2-4289-9e6a-1cda3dd97d5a" returned: 0 in 0.606s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-quobyte-cf167370-8da2-4289-9e6a-1cda3dd97d5a" released by "delete_volume" :: held 1.753s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:39 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Created reservations ['564b7266-3186-43e8-9d37-2473d67fb8f9', 'dc7dd485-a41a-44cd-b875-71782d251479', 'f4f5a210-045f-42fe-a079-050ba71056df', 'c7f20011-c469-40cc-bf94-5ad61612b70a'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:11:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:39 devstack sudo[100373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:11:39 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "cinder-b39b1e67-57c2-4658-9171-b4da980b50b9-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-b39b1e67-57c2-4658-9171-b4da980b50b9-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "cinder-quobyte-b39b1e67-57c2-4658-9171-b4da980b50b9" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-quobyte-b39b1e67-57c2-4658-9171-b4da980b50b9" acquired by "delete_volume" :: waited 0.050s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:40 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4792882-10c2-4211-898f-5a136a40bca7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b39b1e67-57c2-4658-9171-b4da980b50b9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:40 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.766s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:40 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:11:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Deleted volume successfully.
Sep 25 15:11:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a63d9f5d-e75b-4fa1-bba8-04324072e1ab tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-cf167370-8da2-4289-9e6a-1cda3dd97d5a-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:40 devstack sudo[100376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b39b1e67-57c2-4658-9171-b4da980b50b9
Sep 25 15:11:40 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:41 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b39b1e67-57c2-4658-9171-b4da980b50b9" returned: 0 in 0.722s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b39b1e67-57c2-4658-9171-b4da980b50b9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:41 devstack sudo[100381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b39b1e67-57c2-4658-9171-b4da980b50b9
Sep 25 15:11:41 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:41 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b39b1e67-57c2-4658-9171-b4da980b50b9" returned: 0 in 0.737s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-quobyte-b39b1e67-57c2-4658-9171-b4da980b50b9" released by "delete_volume" :: held 1.589s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:41 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Created reservations ['7b086d23-9124-4720-8e73-5a6db355c3d8', '0360202e-7bae-4e10-8de8-16ba7536318a', '57d88bea-814f-4869-ac5e-9959578e6de4', '480a134d-60a4-4666-8185-4ce0865feca4'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:11:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:42 devstack sudo[100385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:11:42 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "cinder-66a003ae-6dba-4a33-b69b-6835354cb5fe-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-66a003ae-6dba-4a33-b69b-6835354cb5fe-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:42 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.763s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:42 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:11:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "cinder-quobyte-66a003ae-6dba-4a33-b69b-6835354cb5fe" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:11:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Deleted volume successfully.
Sep 25 15:11:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-quobyte-66a003ae-6dba-4a33-b69b-6835354cb5fe" acquired by "delete_volume" :: waited 0.066s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:11:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-54aaf883-83cc-4391-ace7-ce695fe80421 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-b39b1e67-57c2-4658-9171-b4da980b50b9-delete_volume" released by "delete_volume" :: held 3.033s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:43 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d87d33a-274a-42fc-9ac4-3f56e227287c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-66a003ae-6dba-4a33-b69b-6835354cb5fe {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:43 devstack sudo[100388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-66a003ae-6dba-4a33-b69b-6835354cb5fe
Sep 25 15:11:43 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:44 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-66a003ae-6dba-4a33-b69b-6835354cb5fe" returned: 0 in 0.999s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-66a003ae-6dba-4a33-b69b-6835354cb5fe {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:44 devstack sudo[100393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-66a003ae-6dba-4a33-b69b-6835354cb5fe
Sep 25 15:11:44 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:44 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-66a003ae-6dba-4a33-b69b-6835354cb5fe" returned: 0 in 0.673s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-quobyte-66a003ae-6dba-4a33-b69b-6835354cb5fe" released by "delete_volume" :: held 1.812s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:44 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Created reservations ['f1fb9338-bd2b-4c9e-9db9-5b2b07a6250f', '431db745-501c-4e4d-b35a-5a9685a11e0a', '157a944e-93e1-42d5-a3de-d8486317e160', '8a0f176d-f340-45e5-82ad-fb9b57a84ded'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:11:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:11:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:11:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:11:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:11:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:45 devstack sudo[100396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:11:45 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:45 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e5bdfd09-21dd-4a81-b83e-2d08beb7a7e6 tempest-TestImageHashVerification-1725106439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03 /opt/stack/data/cinder/conversion/4a610a5b-30ed-4c3a-82b7-05a8e89bcc03.temp_image.55b353b2-6d94-4ad8-bd9e-a38bd43691fdur_hyx0i.img" returned: 0 in 9.434s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:45 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eef55e0-913b-4951-8d50-710c5f1f1917]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:11:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e5bdfd09-21dd-4a81-b83e-2d08beb7a7e6 tempest-TestImageHashVerification-1725106439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:11:45 devstack sudo[100398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03
Sep 25 15:11:45 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:11:45 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.417s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:45 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:11:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Deleted volume successfully.
Sep 25 15:11:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-fea66e75-3dd7-48da-8c4e-91923fe8b316 tempest-CreateVolumesFromSourceVolumeTest-171165591 None] Lock "cinder-66a003ae-6dba-4a33-b69b-6835354cb5fe-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:11:46 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root
Sep 25 15:11:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e5bdfd09-21dd-4a81-b83e-2d08beb7a7e6 tempest-TestImageHashVerification-1725106439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03" returned: 0 in 0.691s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:11:46 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-e5bdfd09-21dd-4a81-b83e-2d08beb7a7e6 tempest-TestImageHashVerification-1725106439 None] Image conversion details: src /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03, size 1024.00 MB, duration 9.44 sec, destination /opt/stack/data/cinder/conversion/4a610a5b-30ed-4c3a-82b7-05a8e89bcc03.temp_image.55b353b2-6d94-4ad8-bd9e-a38bd43691fdur_hyx0i.img {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:11:46 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-e5bdfd09-21dd-4a81-b83e-2d08beb7a7e6 tempest-TestImageHashVerification-1725106439 None] Converted 1024.00 MB image at 108.47 MB/s
Sep 25 15:11:46 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-e5bdfd09-21dd-4a81-b83e-2d08beb7a7e6 tempest-TestImageHashVerification-1725106439 None] 55b353b2-6d94-4ad8-bd9e-a38bd43691fd was raw, no need to convert to raw {{(pid=87071) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Flow 'volume_create_manager' (2f47a759-9b8d-4ca1-bf49-9cfe87dc3493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fda538f-2bf9-4873-a04e-5f04adcdd986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fda538f-2bf9-4873-a04e-5f04adcdd986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-779839157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a196b5-45ae-46b3-9763-3c11b4483e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c49c42e7f64646419b5cf931f80d20d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:50Z,use_quota=True,user_id='ec6b7b3a6acc441396ab7f368fa6d14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82ad794-5472-409a-8c81-59687d99b721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e82ad794-5472-409a-8c81-59687d99b721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed5f49a-bfb8-45df-bd01-72af8e686f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed5f49a-bfb8-45df-bd01-72af8e686f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96a196b5-45ae-46b3-9763-3c11b4483e26', 'volume_name': 'volume-96a196b5-45ae-46b3-9763-3c11b4483e26', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d849352-610b-4dbd-9144-c96baddbfbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d849352-610b-4dbd-9144-c96baddbfbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553c0c91-daa0-476b-83d8-450074ca6797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:50 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Volume 96a196b5-45ae-46b3-9763-3c11b4483e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96a196b5-45ae-46b3-9763-3c11b4483e26', 'volume_size': 1}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Flow 'volume_create_manager' (7d594151-5ac4-40d0-b580-19d5b61b390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6839a39f-2310-4868-b0f0-1b57505b5664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6839a39f-2310-4868-b0f0-1b57505b5664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-609470928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a49193-8174-447a-a48e-cd32e02bce7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd8cb4ec542a41f6aea08ff46f489476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:51Z,use_quota=True,user_id='6cc56f335347461da73e37f491b5d005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48483665-eea6-410e-980a-dec01cfd23b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48483665-eea6-410e-980a-dec01cfd23b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ca4598-8ffe-4bcc-a729-15396eddeb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ca4598-8ffe-4bcc-a729-15396eddeb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8a49193-8174-447a-a48e-cd32e02bce7a', 'volume_name': 'volume-d8a49193-8174-447a-a48e-cd32e02bce7a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b73b2ef-9b1f-40e8-adcf-76c1eec64baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b73b2ef-9b1f-40e8-adcf-76c1eec64baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ad4ab5-98ce-4e4d-ba48-6d6cab75317e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:11:50 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Volume d8a49193-8174-447a-a48e-cd32e02bce7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8a49193-8174-447a-a48e-cd32e02bce7a', 'volume_size': 1}
Sep 25 15:11:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:00 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=110,cinder:SELECT=74,cinder:INSERT=19,cinder:DELETE=10 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:12:00 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=163,cinder:SELECT=123,cinder:DELETE=14,cinder:INSERT=45 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:12:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e5bdfd09-21dd-4a81-b83e-2d08beb7a7e6 tempest-TestImageHashVerification-1725106439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.132s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e5bdfd09-21dd-4a81-b83e-2d08beb7a7e6 tempest-TestImageHashVerification-1725106439 None] Uploaded volume to glance image-id: 55b353b2-6d94-4ad8-bd9e-a38bd43691fd. {{(pid=87071) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 25 15:12:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 33.053s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1254742173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd37558-3b97-4054-8211-c8710a3010ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa66e252a7f406ebb8d2e27114c2d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:35Z,use_quota=True,user_id='5bf9e57eb2dc424484bb729aa4cc5977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:12:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Creating volume bdd37558-3b97-4054-8211-c8710a3010ab {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:12:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:12:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:12:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:12:07 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:12:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bdd37558-3b97-4054-8211-c8710a3010ab 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:07 devstack sudo[100456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bdd37558-3b97-4054-8211-c8710a3010ab 1073741824
Sep 25 15:12:07 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:07 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e5bdfd09-21dd-4a81-b83e-2d08beb7a7e6 tempest-TestImageHashVerification-1725106439 None] Copy volume to image completed successfully.
Sep 25 15:12:08 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bdd37558-3b97-4054-8211-c8710a3010ab 1073741824" returned: 0 in 0.482s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bdd37558-3b97-4054-8211-c8710a3010ab {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:08 devstack sudo[100461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bdd37558-3b97-4054-8211-c8710a3010ab
Sep 25 15:12:08 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:08 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bdd37558-3b97-4054-8211-c8710a3010ab" returned: 0 in 0.317s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.162s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-779839157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a196b5-45ae-46b3-9763-3c11b4483e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c49c42e7f64646419b5cf931f80d20d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:50Z,use_quota=True,user_id='ec6b7b3a6acc441396ab7f368fa6d14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Creating volume 96a196b5-45ae-46b3-9763-3c11b4483e26 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:12:08 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:08 devstack sudo[100464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26 1073741824
Sep 25 15:12:08 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c87885-d173-4f18-9164-1dbc2b6ca51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdd37558-3b97-4054-8211-c8710a3010ab', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360da087-acd2-4e96-a30e-2a3dae44dbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:08 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Volume volume-bdd37558-3b97-4054-8211-c8710a3010ab (bdd37558-3b97-4054-8211-c8710a3010ab): created successfully
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360da087-acd2-4e96-a30e-2a3dae44dbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Flow 'volume_create_manager' (e86d6713-dcc6-4290-abea-a3cf3889ceb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:12:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5a55f0e6-45d6-49c9-8550-b44508b0a98d tempest-VolumesActionsTest-1345218368 None] Created volume successfully.
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Acquiring lock "cinder-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Lock "cinder-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Acquiring lock "cinder-quobyte-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Lock "cinder-quobyte-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8a9cac-0948-4dc2-b763-a6914f580188]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:09 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26 1073741824" returned: 0 in 0.560s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:09 devstack sudo[100470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03
Sep 25 15:12:09 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:09 devstack sudo[100472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26
Sep 25 15:12:09 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:09 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26" returned: 0 in 0.291s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.966s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-609470928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a49193-8174-447a-a48e-cd32e02bce7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd8cb4ec542a41f6aea08ff46f489476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:11:51Z,use_quota=True,user_id='6cc56f335347461da73e37f491b5d005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Creating volume d8a49193-8174-447a-a48e-cd32e02bce7a {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:12:09 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:12:09 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03" returned: 0 in 0.488s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:09 devstack sudo[100478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a 1073741824
Sep 25 15:12:09 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:09 devstack sudo[100479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553c0c91-daa0-476b-83d8-450074ca6797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a196b5-45ae-46b3-9763-3c11b4483e26', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:09 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487e621f-e85e-4479-b728-93d1c587ca14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:09 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Volume volume-96a196b5-45ae-46b3-9763-3c11b4483e26 (96a196b5-45ae-46b3-9763-3c11b4483e26): created successfully
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487e621f-e85e-4479-b728-93d1c587ca14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Flow 'volume_create_manager' (2f47a759-9b8d-4ca1-bf49-9cfe87dc3493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:12:09 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c9fa2b08-0bc8-4d72-8d9e-b29012a2c02d tempest-VolumeDependencyTests-581755635 None] Created volume successfully.
Sep 25 15:12:10 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03" returned: 0 in 0.339s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Lock "cinder-quobyte-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03" released by "delete_volume" :: held 0.881s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Created reservations ['b4f2437b-9269-404e-8ec5-897722414299', '1852f697-269e-4f18-aecc-12b881f5fe02', '0206a905-d81f-44d8-bb5a-623ab6cb6df6', '19d8891a-d1df-4e3d-acca-293c133d9fac'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Acquiring lock "cinder-bdd37558-3b97-4054-8211-c8710a3010ab-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Lock "cinder-bdd37558-3b97-4054-8211-c8710a3010ab-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:10 devstack sudo[100487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:12:10 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:10 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Acquiring lock "cinder-quobyte-bdd37558-3b97-4054-8211-c8710a3010ab" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a 1073741824" returned: 0 in 0.678s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Lock "cinder-quobyte-bdd37558-3b97-4054-8211-c8710a3010ab" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4720fa-341b-4562-9139-5ad9cef5c7d9]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bdd37558-3b97-4054-8211-c8710a3010ab {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:10 devstack sudo[100489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a
Sep 25 15:12:10 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:10 devstack sudo[100490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bdd37558-3b97-4054-8211-c8710a3010ab
Sep 25 15:12:10 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:10 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.381s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:12:10 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Deleted volume successfully.
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1461e0bf-40eb-4260-a308-6290196dd87e tempest-TestImageHashVerification-1725106439 None] Lock "cinder-4a610a5b-30ed-4c3a-82b7-05a8e89bcc03-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:10 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a" returned: 0 in 0.367s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ad4ab5-98ce-4e4d-ba48-6d6cab75317e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a49193-8174-447a-a48e-cd32e02bce7a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9caf6d96-61c4-4520-96a5-2648a610df41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:10 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Volume volume-d8a49193-8174-447a-a48e-cd32e02bce7a (d8a49193-8174-447a-a48e-cd32e02bce7a): created successfully
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9caf6d96-61c4-4520-96a5-2648a610df41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Flow 'volume_create_manager' (7d594151-5ac4-40d0-b580-19d5b61b390c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:12:10 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ca9b45eb-e497-43b3-818e-10cb8f1802d6 tempest-VolumesDeleteCascade-1312446618 None] Created volume successfully.
Sep 25 15:12:11 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bdd37558-3b97-4054-8211-c8710a3010ab" returned: 0 in 0.621s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bdd37558-3b97-4054-8211-c8710a3010ab {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:11 devstack sudo[100498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bdd37558-3b97-4054-8211-c8710a3010ab
Sep 25 15:12:11 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] Creating offline snapshot 56940d98-1004-411b-be0a-3a885e543616 of volume 96a196b5-45ae-46b3-9763-3c11b4483e26 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ee955a-aa27-488c-bff7-91c3e7d63dbf]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:11 devstack sudo[100500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26
Sep 25 15:12:11 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:11 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bdd37558-3b97-4054-8211-c8710a3010ab" returned: 0 in 0.333s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Lock "cinder-quobyte-bdd37558-3b97-4054-8211-c8710a3010ab" released by "delete_volume" :: held 1.029s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Created reservations ['f786f56b-15cc-44d0-a1cf-d183163be5cd', '92ad62d4-a037-4e7d-a99d-038140475a00', 'a63932ee-aed6-47d2-971e-5f6dc33845e0', '97f97a69-a272-410f-bc48-4b5127b87882'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:11 devstack sudo[100503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:12:11 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:11 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26" returned: 0 in 0.473s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:11 devstack sudo[100508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616 1G
Sep 25 15:12:11 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:11 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.301s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:12:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Deleted volume successfully.
Sep 25 15:12:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-546c66ab-4ae2-489e-992c-255608b6e87a tempest-VolumesActionsTest-779608173 None] Lock "cinder-bdd37558-3b97-4054-8211-c8710a3010ab-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:12 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616 1G" returned: 0 in 0.621s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a196b5-45ae-46b3-9763-3c11b4483e26 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:12 devstack sudo[100516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a196b5-45ae-46b3-9763-3c11b4483e26 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616
Sep 25 15:12:12 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:12 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a196b5-45ae-46b3-9763-3c11b4483e26 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616" returned: 0 in 0.436s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:12 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616 is being set with open permissions: ugo+rw
Sep 25 15:12:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:12 devstack sudo[100521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616
Sep 25 15:12:12 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:13 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616" returned: 0 in 0.318s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:13 devstack sudo[100524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.info
Sep 25 15:12:13 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Flow 'volume_create_manager' (691f24b3-8811-4b4f-9473-3f8abda9d7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579d15a0-38c5-44ab-916d-cceff5f78d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579d15a0-38c5-44ab-916d-cceff5f78d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-796562089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab26cea-1d67-460f-8148-6858de9724e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa66e252a7f406ebb8d2e27114c2d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:12:13Z,use_quota=True,user_id='5bf9e57eb2dc424484bb729aa4cc5977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa721cdd-f4fa-448f-907d-075dd4046a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa721cdd-f4fa-448f-907d-075dd4046a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0bc2a3-1e57-493b-b62b-48500f746bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0bc2a3-1e57-493b-b62b-48500f746bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eab26cea-1d67-460f-8148-6858de9724e0', 'volume_name': 'volume-eab26cea-1d67-460f-8148-6858de9724e0', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed7af170-1c08-4615-b9d4-01ea7533bfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed7af170-1c08-4615-b9d4-01ea7533bfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:13 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe0a841-e517-4cec-bbec-a3da501cb5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:13 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Volume eab26cea-1d67-460f-8148-6858de9724e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eab26cea-1d67-460f-8148-6858de9724e0', 'volume_size': 1}
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.info" returned: 0 in 0.372s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:13 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.info is being set with open permissions: ugo+rw
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:13 devstack sudo[100527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.info
Sep 25 15:12:13 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:13 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.info" returned: 0 in 0.322s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.731s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.529s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] Creating offline snapshot bc966082-83c1-4e48-b44b-d4e53534495d of volume d8a49193-8174-447a-a48e-cd32e02bce7a {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:12:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-bcc2b65d-fb0e-45eb-b898-d93f94837c51 tempest-VolumeDependencyTests-581755635 None] Create snapshot completed successfully
Sep 25 15:12:14 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7178e309-c4f2-480e-a828-8fe1fddd22db]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:14 devstack sudo[100530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a
Sep 25 15:12:14 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:14 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a" returned: 0 in 0.486s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:14 devstack sudo[100535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d 1G
Sep 25 15:12:14 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:12:15 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d 1G" returned: 0 in 0.786s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8a49193-8174-447a-a48e-cd32e02bce7a -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:15 devstack sudo[100541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8a49193-8174-447a-a48e-cd32e02bce7a -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d
Sep 25 15:12:15 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Flow 'volume_create_manager' (759a3a45-8b19-4c16-a53d-782e2b41a484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe1a83a-1824-4409-9e2b-38c4a44000c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe1a83a-1824-4409-9e2b-38c4a44000c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-227143838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1f6fdd-b363-4143-bd49-c7cda400c665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c49c42e7f64646419b5cf931f80d20d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=56940d98-1004-411b-be0a-3a885e543616,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:12:15Z,use_quota=True,user_id='ec6b7b3a6acc441396ab7f368fa6d14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b3fbe2-898b-4c9f-8add-0cf409f5103f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b3fbe2-898b-4c9f-8add-0cf409f5103f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25985c9d-f120-4895-af54-f6e2cba36a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25985c9d-f120-4895-af54-f6e2cba36a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fe1f6fdd-b363-4143-bd49-c7cda400c665', 'volume_name': 'volume-fe1f6fdd-b363-4143-bd49-c7cda400c665', 'volume_size': 1, 'snapshot_id': '56940d98-1004-411b-be0a-3a885e543616'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49ae321-a969-49dc-808a-a466d0e27fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49ae321-a969-49dc-808a-a466d0e27fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad564a8-100f-46cc-b055-7c6c2b000435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Volume fe1f6fdd-b363-4143-bd49-c7cda400c665: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fe1f6fdd-b363-4143-bd49-c7cda400c665', 'volume_size': 1, 'snapshot_id': '56940d98-1004-411b-be0a-3a885e543616'}
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:15 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8a49193-8174-447a-a48e-cd32e02bce7a -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d" returned: 0 in 0.356s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:15 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d is being set with open permissions: ugo+rw
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:15 devstack sudo[100546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d
Sep 25 15:12:15 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:15 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d" returned: 0 in 0.290s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:16 devstack sudo[100549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.info
Sep 25 15:12:16 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:16 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.info" returned: 0 in 0.292s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:16 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.info is being set with open permissions: ugo+rw
Sep 25 15:12:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:16 devstack sudo[100552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.info
Sep 25 15:12:16 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:16 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.info" returned: 0 in 0.399s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.740s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.101s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-796562089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab26cea-1d67-460f-8148-6858de9724e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa66e252a7f406ebb8d2e27114c2d61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:12:13Z,use_quota=True,user_id='5bf9e57eb2dc424484bb729aa4cc5977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:12:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Creating volume eab26cea-1d67-460f-8148-6858de9724e0 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:12:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:12:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:12:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:12:16 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:12:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eab26cea-1d67-460f-8148-6858de9724e0 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:16 devstack sudo[100556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eab26cea-1d67-460f-8148-6858de9724e0 1073741824
Sep 25 15:12:16 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5de7171c-ef54-424e-909c-65a5f25b8435 tempest-VolumesDeleteCascade-1312446618 None] Create snapshot completed successfully
Sep 25 15:12:17 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eab26cea-1d67-460f-8148-6858de9724e0 1073741824" returned: 0 in 0.619s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eab26cea-1d67-460f-8148-6858de9724e0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:17 devstack sudo[100562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eab26cea-1d67-460f-8148-6858de9724e0
Sep 25 15:12:17 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:17 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eab26cea-1d67-460f-8148-6858de9724e0" returned: 0 in 0.503s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.466s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Acquiring lock "cinder-quobyte-56940d98-1004-411b-be0a-3a885e543616-fe1f6fdd-b363-4143-bd49-c7cda400c665" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe0a841-e517-4cec-bbec-a3da501cb5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab26cea-1d67-460f-8148-6858de9724e0', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171d12fc-8e2b-4406-9a44-cac72c414e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-quobyte-56940d98-1004-411b-be0a-3a885e543616-fe1f6fdd-b363-4143-bd49-c7cda400c665" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Creating volume fe1f6fdd-b363-4143-bd49-c7cda400c665 from snapshot 56940d98-1004-411b-be0a-3a885e543616 {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:12:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Acquiring lock "cinder-quobyte-fe1f6fdd-b363-4143-bd49-c7cda400c665" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:18 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Volume volume-eab26cea-1d67-460f-8148-6858de9724e0 (eab26cea-1d67-460f-8148-6858de9724e0): created successfully
Sep 25 15:12:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171d12fc-8e2b-4406-9a44-cac72c414e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Flow 'volume_create_manager' (691f24b3-8811-4b4f-9473-3f8abda9d7e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:12:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-quobyte-fe1f6fdd-b363-4143-bd49-c7cda400c665" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] snapshot: 56940d98-1004-411b-be0a-3a885e543616, volume: fe1f6fdd-b363-4143-bd49-c7cda400c665,  {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 15:12:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:12:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:12:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-07a90114-204f-4831-8d19-5054d48ebbdb tempest-VolumesActionsTest-1345218368 None] Created volume successfully.
Sep 25 15:12:18 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfa38ef-2b4f-4058-bebd-496c5ccc15b9]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ea01a5b6-463f-4804-b10f-71ae1bb0a285 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:18 devstack sudo[100566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616
Sep 25 15:12:18 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:18 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616" returned: 0 in 0.575s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a196b5-45ae-46b3-9763-3c11b4483e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:12:18 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8136328f-e516-4a47-bd57-d77a7a72312a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:18 devstack sudo[100572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26
Sep 25 15:12:18 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:19 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26" returned: 0 in 0.506s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 15:12:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 15:12:19 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Path /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fe1f6fdd-b363-4143-bd49-c7cda400c665 not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 15:12:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fe1f6fdd-b363-4143-bd49-c7cda400c665 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:19 devstack sudo[100578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fe1f6fdd-b363-4143-bd49-c7cda400c665
Sep 25 15:12:19 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Acquiring lock "cinder-eab26cea-1d67-460f-8148-6858de9724e0-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Lock "cinder-eab26cea-1d67-460f-8148-6858de9724e0-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Acquiring lock "cinder-quobyte-eab26cea-1d67-460f-8148-6858de9724e0" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Lock "cinder-quobyte-eab26cea-1d67-460f-8148-6858de9724e0" acquired by "delete_volume" :: waited 0.052s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:20 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[68214731-59c4-4555-9ad5-4aa8b1d2801d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eab26cea-1d67-460f-8148-6858de9724e0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:12:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:20 devstack sudo[100590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eab26cea-1d67-460f-8148-6858de9724e0
Sep 25 15:12:20 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:12:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:12:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:20 devstack sudo[100592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:12:20 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:21 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.550s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:12:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:12:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:12:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:12:21 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eab26cea-1d67-460f-8148-6858de9724e0" returned: 0 in 1.373s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eab26cea-1d67-460f-8148-6858de9724e0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:21 devstack sudo[100598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eab26cea-1d67-460f-8148-6858de9724e0
Sep 25 15:12:21 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:22 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eab26cea-1d67-460f-8148-6858de9724e0" returned: 0 in 0.648s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Lock "cinder-quobyte-eab26cea-1d67-460f-8148-6858de9724e0" released by "delete_volume" :: held 2.166s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:22 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Created reservations ['23303fe3-b18c-4b41-b01d-21b50a085610', '618a9a8e-9584-46ed-b82e-a45ab98c7c81', '377989ee-346f-4f7a-b8fc-baf471c95f45', '23c8f565-c344-46bd-bd88-564ff254ae45'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:12:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:12:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:12:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:22 devstack sudo[100601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:12:22 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:23 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.920s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:23 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:12:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Deleted volume successfully.
Sep 25 15:12:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0890795f-301a-42a2-8c04-8f022639437e tempest-VolumesActionsTest-1345218368 None] Lock "cinder-eab26cea-1d67-460f-8148-6858de9724e0-delete_volume" released by "delete_volume" :: held 3.753s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:28 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fe1f6fdd-b363-4143-bd49-c7cda400c665" returned: 0 in 9.363s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:28 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Image conversion details: src /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26, size 1024.00 MB, duration 9.36 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fe1f6fdd-b363-4143-bd49-c7cda400c665 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:12:28 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Converted 1024.00 MB image at 109.36 MB/s
Sep 25 15:12:28 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fe1f6fdd-b363-4143-bd49-c7cda400c665 is being set with open permissions: ugo+rw
Sep 25 15:12:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fe1f6fdd-b363-4143-bd49-c7cda400c665 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:28 devstack sudo[100608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fe1f6fdd-b363-4143-bd49-c7cda400c665
Sep 25 15:12:28 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:28 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fe1f6fdd-b363-4143-bd49-c7cda400c665" returned: 0 in 0.313s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-quobyte-fe1f6fdd-b363-4143-bd49-c7cda400c665" released by "_copy_volume_from_snapshot" :: held 10.948s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-quobyte-56940d98-1004-411b-be0a-3a885e543616-fe1f6fdd-b363-4143-bd49-c7cda400c665" released by "_create_volume_from_snapshot" :: held 11.074s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.123s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ea01a5b6-463f-4804-b10f-71ae1bb0a285 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.827s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ea01a5b6-463f-4804-b10f-71ae1bb0a285 tempest-VolumesDeleteCascade-1312446618 None] Creating offline snapshot c93d0506-f01f-48a9-8772-1c68e9b1aa0c of volume d8a49193-8174-447a-a48e-cd32e02bce7a {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:12:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad564a8-100f-46cc-b055-7c6c2b000435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe1f6fdd-b363-4143-bd49-c7cda400c665', 'volume_size': 1, 'snapshot_id': '56940d98-1004-411b-be0a-3a885e543616'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61c54fc-306f-4450-94ce-46e434a0a746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:29 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f198376-9d71-4474-b3d2-66721f64c0b3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea01a5b6-463f-4804-b10f-71ae1bb0a285 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:29 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Volume volume-fe1f6fdd-b363-4143-bd49-c7cda400c665 (fe1f6fdd-b363-4143-bd49-c7cda400c665): created successfully
Sep 25 15:12:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61c54fc-306f-4450-94ce-46e434a0a746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Flow 'volume_create_manager' (759a3a45-8b19-4c16-a53d-782e2b41a484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:12:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-67198090-1223-4172-94bc-904f53d35463 tempest-VolumeDependencyTests-581755635 None] Created volume successfully.
Sep 25 15:12:29 devstack sudo[100611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d
Sep 25 15:12:29 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:29 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea01a5b6-463f-4804-b10f-71ae1bb0a285 tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d" returned: 0 in 0.569s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ea01a5b6-463f-4804-b10f-71ae1bb0a285 tempest-VolumesDeleteCascade-1312446618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8a49193-8174-447a-a48e-cd32e02bce7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:12:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea01a5b6-463f-4804-b10f-71ae1bb0a285 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:29 devstack sudo[100616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c 1G
Sep 25 15:12:29 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Acquiring lock "cinder-56940d98-1004-411b-be0a-3a885e543616-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-56940d98-1004-411b-be0a-3a885e543616-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Acquiring lock "cinder-quobyte-96a196b5-45ae-46b3-9763-3c11b4483e26" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-quobyte-96a196b5-45ae-46b3-9763-3c11b4483e26" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Acquiring lock "cinder-quobyte-56940d98-1004-411b-be0a-3a885e543616" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-quobyte-56940d98-1004-411b-be0a-3a885e543616" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Deleting offline snapshot 56940d98-1004-411b-be0a-3a885e543616 of volume 96a196b5-45ae-46b3-9763-3c11b4483e26 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:12:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] snapshot_file for this snap is: volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:12:30 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75d5a0a-58c3-4c79-a1c6-25da7d82115d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:30 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea01a5b6-463f-4804-b10f-71ae1bb0a285 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c 1G" returned: 0 in 0.798s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea01a5b6-463f-4804-b10f-71ae1bb0a285 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:30 devstack sudo[100623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c
Sep 25 15:12:30 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:30 devstack sudo[100622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616
Sep 25 15:12:30 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:30 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea01a5b6-463f-4804-b10f-71ae1bb0a285 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c" returned: 0 in 0.361s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:30 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-ea01a5b6-463f-4804-b10f-71ae1bb0a285 tempest-VolumesDeleteCascade-1312446618 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c is being set with open permissions: ugo+rw
Sep 25 15:12:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea01a5b6-463f-4804-b10f-71ae1bb0a285 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:30 devstack sudo[100629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c
Sep 25 15:12:30 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:31 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616" returned: 0 in 0.556s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a196b5-45ae-46b3-9763-3c11b4483e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:12:31 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef69b10-f097-44f6-92b6-6567e15e0fba]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:31 devstack sudo[100634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26
Sep 25 15:12:31 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:31 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea01a5b6-463f-4804-b10f-71ae1bb0a285 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c" returned: 0 in 0.346s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ea01a5b6-463f-4804-b10f-71ae1bb0a285 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.293s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ea01a5b6-463f-4804-b10f-71ae1bb0a285 tempest-VolumesDeleteCascade-1312446618 None] Create snapshot completed successfully
Sep 25 15:12:31 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26" returned: 0 in 0.666s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:31 devstack sudo[100640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616
Sep 25 15:12:31 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:32 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616" returned: 0 in 0.473s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-d8a49193-8174-447a-a48e-cd32e02bce7a-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:32 devstack sudo[100645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616
Sep 25 15:12:32 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-d8a49193-8174-447a-a48e-cd32e02bce7a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Performing cascade delete. {{(pid=87071) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-bc966082-83c1-4e48-b44b-d4e53534495d-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-bc966082-83c1-4e48-b44b-d4e53534495d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-quobyte-d8a49193-8174-447a-a48e-cd32e02bce7a" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-d8a49193-8174-447a-a48e-cd32e02bce7a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-quobyte-bc966082-83c1-4e48-b44b-d4e53534495d" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-bc966082-83c1-4e48-b44b-d4e53534495d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Deleting offline snapshot bc966082-83c1-4e48-b44b-d4e53534495d of volume d8a49193-8174-447a-a48e-cd32e02bce7a {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] snapshot_file for this snap is: volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d96dc0d-215e-4d0e-9633-b0da525694a3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:32 devstack sudo[100647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d
Sep 25 15:12:32 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:32 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26.56940d98-1004-411b-be0a-3a885e543616" returned: 0 in 0.445s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-quobyte-56940d98-1004-411b-be0a-3a885e543616" released by "_delete_snapshot" :: held 2.318s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-quobyte-96a196b5-45ae-46b3-9763-3c11b4483e26" released by "delete_snapshot" :: held 2.356s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:32 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Created reservations ['c2b3a51d-53c0-4300-96ad-478b86791d53', '1583dda9-43c6-400d-ac9e-58d4b6e001d4', '2a7ba94b-6520-473b-b676-0820582b9fcb', '7ff53784-aff2-45c3-83fe-469c4d9f1a05'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:12:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Delete snapshot completed successfully.
Sep 25 15:12:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0caf06ed-a027-4130-bd3b-3a5bed8c9068 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-56940d98-1004-411b-be0a-3a885e543616-delete_snapshot" released by "delete_snapshot" :: held 2.646s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:33 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d" returned: 0 in 0.552s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8a49193-8174-447a-a48e-cd32e02bce7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:12:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bd0b2a-98d5-42be-ba68-5cc7ae57ff4d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:33 devstack sudo[100654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a
Sep 25 15:12:33 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:33 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Acquiring lock "cinder-96a196b5-45ae-46b3-9763-3c11b4483e26-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a" returned: 0 in 0.534s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-96a196b5-45ae-46b3-9763-3c11b4483e26-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb46014-b8b0-42e7-9358-3e548a78071a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Acquiring lock "cinder-quobyte-96a196b5-45ae-46b3-9763-3c11b4483e26" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-quobyte-96a196b5-45ae-46b3-9763-3c11b4483e26" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b707814-c270-4332-b93c-f205fd428463]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:34 devstack sudo[100659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c
Sep 25 15:12:34 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:34 devstack sudo[100660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26
Sep 25 15:12:34 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:34 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26" returned: 0 in 0.560s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:34 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c" returned: 0 in 0.766s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8a49193-8174-447a-a48e-cd32e02bce7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:12:34 devstack sudo[100670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26
Sep 25 15:12:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3748da93-39e8-44ea-bcae-5f674ac89e46]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:34 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:34 devstack sudo[100672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d
Sep 25 15:12:34 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:34 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-96a196b5-45ae-46b3-9763-3c11b4483e26" returned: 0 in 0.425s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-quobyte-96a196b5-45ae-46b3-9763-3c11b4483e26" released by "delete_volume" :: held 1.100s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Created reservations ['4463ec12-c56f-4ca5-8e90-66a86bd5be1d', 'eb12fb1c-c995-4c84-92c6-b6532afc3bc4', '8f843df9-3712-46d5-a1d3-8b508801aaeb', '9030d750-bf13-4be2-b821-812ad2115950'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:12:35 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d" returned: 0 in 0.611s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8a49193-8174-447a-a48e-cd32e02bce7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9714f716-23a6-43c7-bc18-5f37bd71dc74]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:35 devstack sudo[100680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:12:35 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:35 devstack sudo[100679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a
Sep 25 15:12:35 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:35 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.503s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:12:35 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Deleted volume successfully.
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-76c3884c-7b6c-4182-b04c-87725a2edb03 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-96a196b5-45ae-46b3-9763-3c11b4483e26-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:35 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a" returned: 0 in 0.715s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:36 devstack sudo[100689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d
Sep 25 15:12:36 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Acquiring lock "cinder-fe1f6fdd-b363-4143-bd49-c7cda400c665-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-fe1f6fdd-b363-4143-bd49-c7cda400c665-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Acquiring lock "cinder-quobyte-fe1f6fdd-b363-4143-bd49-c7cda400c665" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-quobyte-fe1f6fdd-b363-4143-bd49-c7cda400c665" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:36 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aace5b2e-6f46-45f4-81e7-5b2cded6b002]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fe1f6fdd-b363-4143-bd49-c7cda400c665 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:36 devstack sudo[100691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fe1f6fdd-b363-4143-bd49-c7cda400c665
Sep 25 15:12:36 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:36 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d" returned: 0 in 0.553s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:36 devstack sudo[100697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d
Sep 25 15:12:36 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:36 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fe1f6fdd-b363-4143-bd49-c7cda400c665" returned: 0 in 0.639s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fe1f6fdd-b363-4143-bd49-c7cda400c665 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:36 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.bc966082-83c1-4e48-b44b-d4e53534495d" returned: 0 in 0.436s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8a49193-8174-447a-a48e-cd32e02bce7a /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c -F qcow2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:37 devstack sudo[100703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fe1f6fdd-b363-4143-bd49-c7cda400c665
Sep 25 15:12:37 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:37 devstack sudo[100704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8a49193-8174-447a-a48e-cd32e02bce7a /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c -F qcow2
Sep 25 15:12:37 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:37 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fe1f6fdd-b363-4143-bd49-c7cda400c665" returned: 0 in 0.394s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-quobyte-fe1f6fdd-b363-4143-bd49-c7cda400c665" released by "delete_volume" :: held 1.109s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Created reservations ['17a16896-fa6b-4f5c-85ff-287c1cf45d75', '8786fb31-4012-4dd0-9e84-4325fa915564', 'cfe9babd-1f5e-4389-9227-3f670e0940d9', '19d473f8-e302-4299-9a8e-875ac6093df6'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:12:37 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8a49193-8174-447a-a48e-cd32e02bce7a /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c -F qcow2" returned: 0 in 0.530s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-bc966082-83c1-4e48-b44b-d4e53534495d" released by "_delete_snapshot" :: held 5.039s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-d8a49193-8174-447a-a48e-cd32e02bce7a" released by "delete_snapshot" :: held 5.079s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:37 devstack sudo[100713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:12:37 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Created reservations ['bed24383-790c-44bc-a193-85f78d2c53f2', '4190b02a-833a-4286-a59b-3270b20d1ec8', 'b3fccf0e-0dbe-410f-9160-42e6b03d2d32', '86746ab0-bff9-47f1-a0d5-e9cc84b5c7a5'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:12:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Delete snapshot completed successfully.
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-bc966082-83c1-4e48-b44b-d4e53534495d-delete_snapshot" released by "delete_snapshot" :: held 5.338s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-c93d0506-f01f-48a9-8772-1c68e9b1aa0c-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-c93d0506-f01f-48a9-8772-1c68e9b1aa0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-quobyte-d8a49193-8174-447a-a48e-cd32e02bce7a" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-d8a49193-8174-447a-a48e-cd32e02bce7a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-quobyte-c93d0506-f01f-48a9-8772-1c68e9b1aa0c" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-c93d0506-f01f-48a9-8772-1c68e9b1aa0c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Deleting offline snapshot c93d0506-f01f-48a9-8772-1c68e9b1aa0c of volume d8a49193-8174-447a-a48e-cd32e02bce7a {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] snapshot_file for this snap is: volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:12:37 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.319s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c676ac-388d-40fc-bd16-519eeceeb72e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Deleted volume successfully.
Sep 25 15:12:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bbf9c04-66ed-4a2c-a6a7-6216e22217a3 tempest-VolumeDependencyTests-581755635 None] Lock "cinder-fe1f6fdd-b363-4143-bd49-c7cda400c665-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:38 devstack sudo[100716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c
Sep 25 15:12:38 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:38 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c" returned: 0 in 0.494s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8a49193-8174-447a-a48e-cd32e02bce7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:12:38 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[814a454b-5eef-4ff6-9a96-068df4b97a32]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:38 devstack sudo[100721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a
Sep 25 15:12:38 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:39 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a" returned: 0 in 0.741s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:39 devstack sudo[100726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c
Sep 25 15:12:39 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:39 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c" returned: 0 in 0.562s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:39 devstack sudo[100731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c
Sep 25 15:12:39 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:40 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a.c93d0506-f01f-48a9-8772-1c68e9b1aa0c" returned: 0 in 0.455s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-c93d0506-f01f-48a9-8772-1c68e9b1aa0c" released by "_delete_snapshot" :: held 2.452s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-d8a49193-8174-447a-a48e-cd32e02bce7a" released by "delete_snapshot" :: held 2.492s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:40 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Created reservations ['065ac3c8-f99a-4e38-ad4f-8012128b4394', '12049b1a-0160-4619-914f-b9db00b656a2', '12881e37-0127-4e9f-9f0e-0785b0bebdf3', '7ceaa7db-d07a-447f-8db2-a41ca7bccfc9'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:12:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Delete snapshot completed successfully.
Sep 25 15:12:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-c93d0506-f01f-48a9-8772-1c68e9b1aa0c-delete_snapshot" released by "delete_snapshot" :: held 2.727s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Snapshots deleted, issuing volume delete {{(pid=87071) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 25 15:12:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-quobyte-d8a49193-8174-447a-a48e-cd32e02bce7a" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-d8a49193-8174-447a-a48e-cd32e02bce7a" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:40 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20c65d4-eac1-446a-a927-2fa06049aa34]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:40 devstack sudo[100734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a
Sep 25 15:12:40 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:41 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a" returned: 0 in 0.489s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:41 devstack sudo[100739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a
Sep 25 15:12:41 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:41 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a49193-8174-447a-a48e-cd32e02bce7a" returned: 0 in 0.383s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-d8a49193-8174-447a-a48e-cd32e02bce7a" released by "delete_volume" :: held 0.977s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:41 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Created reservations ['10d5f00f-f74a-4c86-b71a-5607266445b1', '852084a4-d7a0-4291-a49c-a15163425f78', 'a7077907-9eee-4e43-8849-fac7ecb2483f', '643f7cbd-5d8d-44dd-9999-bb77d9e1f280'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:12:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:12:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:12:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:41 devstack sudo[100742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:12:41 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:42 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.544s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:42 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:12:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Deleted volume successfully.
Sep 25 15:12:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db2ff258-d591-452e-bbec-3f1fd71edd8b tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-d8a49193-8174-447a-a48e-cd32e02bce7a-delete_volume" released by "delete_volume" :: held 10.019s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Flow 'volume_create_manager' (daa05746-dcd2-4744-9cc4-db0a098f9e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93436f88-25d6-4473-af27-4c5c752051d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93436f88-25d6-4473-af27-4c5c752051d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-733500889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1f100f-c954-4ab7-a227-2dd5abe8cbd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd8cb4ec542a41f6aea08ff46f489476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:12:44Z,use_quota=True,user_id='6cc56f335347461da73e37f491b5d005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddbb1c48-360f-4023-8860-741bab43deb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddbb1c48-360f-4023-8860-741bab43deb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b51caac-ea64-4241-b9aa-b8b533689b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b51caac-ea64-4241-b9aa-b8b533689b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff1f100f-c954-4ab7-a227-2dd5abe8cbd8', 'volume_name': 'volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afdbe516-3e9d-4add-aa5e-d50d5eac808d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afdbe516-3e9d-4add-aa5e-d50d5eac808d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c59b123-bd05-4a77-a7d3-e56d9ddeb516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:44 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Volume ff1f100f-c954-4ab7-a227-2dd5abe8cbd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8', 'volume_size': 1}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-733500889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1f100f-c954-4ab7-a227-2dd5abe8cbd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd8cb4ec542a41f6aea08ff46f489476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:12:44Z,use_quota=True,user_id='6cc56f335347461da73e37f491b5d005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Creating volume ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:12:44 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:12:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:44 devstack sudo[100746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 1073741824
Sep 25 15:12:44 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:45 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 1073741824" returned: 0 in 0.864s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:45 devstack sudo[100752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8
Sep 25 15:12:45 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:46 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8" returned: 0 in 0.479s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:12:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c59b123-bd05-4a77-a7d3-e56d9ddeb516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b52884-4025-4a80-aca3-1714c8ed6d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:46 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Volume volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 (ff1f100f-c954-4ab7-a227-2dd5abe8cbd8): created successfully
Sep 25 15:12:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b52884-4025-4a80-aca3-1714c8ed6d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Flow 'volume_create_manager' (daa05746-dcd2-4744-9cc4-db0a098f9e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:12:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-091aedec-0db0-4aad-940f-6c297002ea2f tempest-VolumesDeleteCascade-1312446618 None] Created volume successfully.
Sep 25 15:12:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] Creating offline snapshot 121c7960-29aa-43a0-b60b-d1c104c4f91b of volume ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:12:46 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[909aa9f2-a872-4ef1-b5dd-103dc96d9052]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:47 devstack sudo[100755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8
Sep 25 15:12:47 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:47 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8" returned: 0 in 0.550s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:47 devstack sudo[100762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b 1G
Sep 25 15:12:47 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:48 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b 1G" returned: 0 in 0.967s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:48 devstack sudo[100768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b
Sep 25 15:12:48 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:48 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b" returned: 0 in 0.487s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:48 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b is being set with open permissions: ugo+rw
Sep 25 15:12:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:48 devstack sudo[100774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b
Sep 25 15:12:48 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:49 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b" returned: 0 in 0.433s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:49 devstack sudo[100777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.info
Sep 25 15:12:49 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:49 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.info" returned: 0 in 0.409s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:49 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.info is being set with open permissions: ugo+rw
Sep 25 15:12:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:49 devstack sudo[100780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.info
Sep 25 15:12:49 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:50 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.info" returned: 0 in 0.356s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.365s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b8776b1d-19cc-4dbf-b646-b88629ebce8b tempest-VolumesDeleteCascade-1312446618 None] Create snapshot completed successfully
Sep 25 15:12:51 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Flow 'volume_create_manager' (2be3b536-d135-43a7-a997-97867b0e29b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8644d44-ad7a-4f94-9ca1-20ad1f96ffab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8644d44-ad7a-4f94-9ca1-20ad1f96ffab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1344038836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea195d2-62d1-420a-99d3-f08c7a46f65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd8cb4ec542a41f6aea08ff46f489476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=121c7960-29aa-43a0-b60b-d1c104c4f91b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:12:52Z,use_quota=True,user_id='6cc56f335347461da73e37f491b5d005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38640a5-c908-4819-a018-736ce99be067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38640a5-c908-4819-a018-736ce99be067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014e6694-8386-4767-8327-e0a115362c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014e6694-8386-4767-8327-e0a115362c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fea195d2-62d1-420a-99d3-f08c7a46f65c', 'volume_name': 'volume-fea195d2-62d1-420a-99d3-f08c7a46f65c', 'volume_size': 1, 'snapshot_id': '121c7960-29aa-43a0-b60b-d1c104c4f91b'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7580a659-4168-4e43-8118-da293988c099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7580a659-4168-4e43-8118-da293988c099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa81dc2-4a5c-4cbd-b81e-e8e77a6d60c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:52 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Volume fea195d2-62d1-420a-99d3-f08c7a46f65c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fea195d2-62d1-420a-99d3-f08c7a46f65c', 'volume_size': 1, 'snapshot_id': '121c7960-29aa-43a0-b60b-d1c104c4f91b'}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-quobyte-121c7960-29aa-43a0-b60b-d1c104c4f91b-fea195d2-62d1-420a-99d3-f08c7a46f65c" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-121c7960-29aa-43a0-b60b-d1c104c4f91b-fea195d2-62d1-420a-99d3-f08c7a46f65c" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Creating volume fea195d2-62d1-420a-99d3-f08c7a46f65c from snapshot 121c7960-29aa-43a0-b60b-d1c104c4f91b {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-quobyte-fea195d2-62d1-420a-99d3-f08c7a46f65c" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-fea195d2-62d1-420a-99d3-f08c7a46f65c" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] snapshot: 121c7960-29aa-43a0-b60b-d1c104c4f91b, volume: fea195d2-62d1-420a-99d3-f08c7a46f65c,  {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f6dcc6-dbc7-4fcb-8863-eed373a8f41f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Flow 'volume_create_manager' (2da68f14-c313-4ebe-8f54-0bc37f5db3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028014be-8e71-4758-9c1d-0edc26d4e2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028014be-8e71-4758-9c1d-0edc26d4e2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1837578767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5049b408-e2ec-40ba-a6b3-ffa909bbf6fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dadfe7e7854511a1b2761f5e852b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:12:52Z,use_quota=True,user_id='920ddaab1548435ca47fc2e5a163a100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe7e4f7-fe4a-412c-b063-eaee00b66ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe7e4f7-fe4a-412c-b063-eaee00b66ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba19de7c-ccb2-44c6-984d-9f0a3e6c9ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba19de7c-ccb2-44c6-984d-9f0a3e6c9ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5049b408-e2ec-40ba-a6b3-ffa909bbf6fa', 'volume_name': 'volume-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74645c81-daa9-4418-a090-9bb20a48832e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74645c81-daa9-4418-a090-9bb20a48832e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d554471-2313-45aa-b631-22116af9cb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:12:52 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Volume 5049b408-e2ec-40ba-a6b3-ffa909bbf6fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa', 'volume_size': 1}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:12:52 devstack sudo[100785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b
Sep 25 15:12:52 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:52 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b" returned: 0 in 0.586s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a4799d-8af4-4d61-8d8b-8103b2214992]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:12:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:53 devstack sudo[100793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8
Sep 25 15:12:53 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:12:53 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root
Sep 25 15:12:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8" returned: 0 in 0.527s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:12:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 15:12:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 15:12:53 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Path /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fea195d2-62d1-420a-99d3-f08c7a46f65c not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 15:12:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fea195d2-62d1-420a-99d3-f08c7a46f65c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:12:53 devstack sudo[100798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fea195d2-62d1-420a-99d3-f08c7a46f65c
Sep 25 15:12:53 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:02 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=77,cinder:UPDATE=85,cinder:DELETE=9,cinder:INSERT=22 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:13:02 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=69,cinder:UPDATE=91,cinder:INSERT=23,cinder:DELETE=7 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:13:02 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fea195d2-62d1-420a-99d3-f08c7a46f65c" returned: 0 in 9.468s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:02 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Image conversion details: src /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8, size 1024.00 MB, duration 9.47 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fea195d2-62d1-420a-99d3-f08c7a46f65c {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:13:02 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Converted 1024.00 MB image at 108.14 MB/s
Sep 25 15:13:02 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fea195d2-62d1-420a-99d3-f08c7a46f65c is being set with open permissions: ugo+rw
Sep 25 15:13:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fea195d2-62d1-420a-99d3-f08c7a46f65c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:02 devstack sudo[100854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fea195d2-62d1-420a-99d3-f08c7a46f65c
Sep 25 15:13:03 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:03 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fea195d2-62d1-420a-99d3-f08c7a46f65c" returned: 0 in 0.303s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-fea195d2-62d1-420a-99d3-f08c7a46f65c" released by "_copy_volume_from_snapshot" :: held 11.031s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-121c7960-29aa-43a0-b60b-d1c104c4f91b-fea195d2-62d1-420a-99d3-f08c7a46f65c" released by "_create_volume_from_snapshot" :: held 11.144s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.187s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.848s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1837578767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5049b408-e2ec-40ba-a6b3-ffa909bbf6fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dadfe7e7854511a1b2761f5e852b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:12:52Z,use_quota=True,user_id='920ddaab1548435ca47fc2e5a163a100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Creating volume 5049b408-e2ec-40ba-a6b3-ffa909bbf6fa {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:13:03 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:03 devstack sudo[100857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa 1073741824
Sep 25 15:13:03 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa81dc2-4a5c-4cbd-b81e-e8e77a6d60c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea195d2-62d1-420a-99d3-f08c7a46f65c', 'volume_size': 1, 'snapshot_id': '121c7960-29aa-43a0-b60b-d1c104c4f91b'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f906b55-9557-4f3a-81b4-86519133c3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:03 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Volume volume-fea195d2-62d1-420a-99d3-f08c7a46f65c (fea195d2-62d1-420a-99d3-f08c7a46f65c): created successfully
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f906b55-9557-4f3a-81b4-86519133c3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Flow 'volume_create_manager' (2be3b536-d135-43a7-a997-97867b0e29b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-bc0db771-3878-4eef-8188-6a763a037306 tempest-VolumesDeleteCascade-1312446618 None] Created volume successfully.
Sep 25 15:13:04 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa 1073741824" returned: 0 in 0.753s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:04 devstack sudo[100863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa
Sep 25 15:13:04 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:04 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa" returned: 0 in 0.346s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:13:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d554471-2313-45aa-b631-22116af9cb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de2104a-f779-4258-9a4f-91710669854f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:04 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Volume volume-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa (5049b408-e2ec-40ba-a6b3-ffa909bbf6fa): created successfully
Sep 25 15:13:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de2104a-f779-4258-9a4f-91710669854f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Flow 'volume_create_manager' (2da68f14-c313-4ebe-8f54-0bc37f5db3a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:04 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d0470806-23d9-4937-9cca-c2da45a9a2ff tempest-VolumesListAdminTestJSON-537359104 None] Created volume successfully.
Sep 25 15:13:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Performing cascade delete. {{(pid=87071) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 25 15:13:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-121c7960-29aa-43a0-b60b-d1c104c4f91b-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-121c7960-29aa-43a0-b60b-d1c104c4f91b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-quobyte-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-quobyte-121c7960-29aa-43a0-b60b-d1c104c4f91b" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-121c7960-29aa-43a0-b60b-d1c104c4f91b" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Deleting offline snapshot 121c7960-29aa-43a0-b60b-d1c104c4f91b of volume ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:13:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] snapshot_file for this snap is: volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:13:05 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24fa0a7-a58d-4909-8958-b8d97217235e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:13:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:05 devstack sudo[100866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b
Sep 25 15:13:05 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:05 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b" returned: 0 in 0.605s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:13:05 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da1f841-32d9-441a-823e-92cb8ed6789b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:13:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:06 devstack sudo[100871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8
Sep 25 15:13:06 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:06 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8" returned: 0 in 0.839s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:06 devstack sudo[100876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b
Sep 25 15:13:06 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Flow 'volume_create_manager' (e38c7222-4c59-4ff0-a978-3c8f415c4ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779e7284-f233-4a95-b1d9-edc9ef5eee4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779e7284-f233-4a95-b1d9-edc9ef5eee4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1062022812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680869bf-3d2a-4203-8ed9-6f5cd97d2968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dadfe7e7854511a1b2761f5e852b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:07Z,use_quota=True,user_id='920ddaab1548435ca47fc2e5a163a100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de883ee9-4c1b-4237-8d7b-be098257bdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de883ee9-4c1b-4237-8d7b-be098257bdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (effd241f-6179-460e-8877-fdec9c2bd703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (effd241f-6179-460e-8877-fdec9c2bd703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '680869bf-3d2a-4203-8ed9-6f5cd97d2968', 'volume_name': 'volume-680869bf-3d2a-4203-8ed9-6f5cd97d2968', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0673a4-f426-4afe-b874-d80760c589fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0673a4-f426-4afe-b874-d80760c589fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b12d01-9be7-40d5-b5b0-095d5f8da0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:06 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Volume 680869bf-3d2a-4203-8ed9-6f5cd97d2968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-680869bf-3d2a-4203-8ed9-6f5cd97d2968', 'volume_size': 1}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1062022812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680869bf-3d2a-4203-8ed9-6f5cd97d2968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dadfe7e7854511a1b2761f5e852b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:07Z,use_quota=True,user_id='920ddaab1548435ca47fc2e5a163a100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Creating volume 680869bf-3d2a-4203-8ed9-6f5cd97d2968 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:13:06 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:13:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-680869bf-3d2a-4203-8ed9-6f5cd97d2968 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:07 devstack sudo[100878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-680869bf-3d2a-4203-8ed9-6f5cd97d2968 1073741824
Sep 25 15:13:07 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:07 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b" returned: 0 in 0.662s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:07 devstack sudo[100884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b
Sep 25 15:13:07 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:07 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8.121c7960-29aa-43a0-b60b-d1c104c4f91b" returned: 0 in 0.483s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:07 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-680869bf-3d2a-4203-8ed9-6f5cd97d2968 1073741824" returned: 0 in 0.924s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-121c7960-29aa-43a0-b60b-d1c104c4f91b" released by "_delete_snapshot" :: held 2.797s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8" released by "delete_snapshot" :: held 2.845s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-680869bf-3d2a-4203-8ed9-6f5cd97d2968 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:08 devstack sudo[100892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-680869bf-3d2a-4203-8ed9-6f5cd97d2968
Sep 25 15:13:08 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:08 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Created reservations ['52bc4e36-3936-45af-8358-ae7c2d6d4f87', 'c7284b2d-1ee0-4901-9ca3-e18f27fa8195', '7650c777-284d-4887-a33b-472e9c5293c7', 'eaa51a92-56a0-45fa-82d2-a703b21e788d'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:13:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Delete snapshot completed successfully.
Sep 25 15:13:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-121c7960-29aa-43a0-b60b-d1c104c4f91b-delete_snapshot" released by "delete_snapshot" :: held 3.184s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Snapshots deleted, issuing volume delete {{(pid=87071) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 25 15:13:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-quobyte-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:08 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cebb442-d062-455c-b2fd-10acfc6fd5e3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:13:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:08 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-680869bf-3d2a-4203-8ed9-6f5cd97d2968" returned: 0 in 0.463s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:13:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b12d01-9be7-40d5-b5b0-095d5f8da0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-680869bf-3d2a-4203-8ed9-6f5cd97d2968', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:08 devstack sudo[100894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8
Sep 25 15:13:08 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8dc70bf-94a4-4995-b111-4f002adc807c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:08 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Volume volume-680869bf-3d2a-4203-8ed9-6f5cd97d2968 (680869bf-3d2a-4203-8ed9-6f5cd97d2968): created successfully
Sep 25 15:13:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8dc70bf-94a4-4995-b111-4f002adc807c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Flow 'volume_create_manager' (e38c7222-4c59-4ff0-a978-3c8f415c4ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-22caab99-1450-4a67-8178-6de26799b5aa tempest-VolumesListAdminTestJSON-537359104 None] Created volume successfully.
Sep 25 15:13:08 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8" returned: 0 in 0.650s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:09 devstack sudo[100900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8
Sep 25 15:13:09 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:09 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8" returned: 0 in 0.567s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8" released by "delete_volume" :: held 1.343s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:09 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Created reservations ['a1d0ab41-e932-4bd4-98e2-bcb47bb4ca31', '356eee5b-977c-46aa-b037-15e1eaa69fb1', '41ff5b43-3466-4349-8d9d-661796b8a9d8', '408d69be-1bc3-45c6-9b6b-ab3ac0f0e309'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:13:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:09 devstack sudo[100903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:13:09 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Flow 'volume_create_manager' (fdcbdba0-217d-457a-a141-c22c7d11dea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa884ce-604f-48f4-87cd-ebfae405e0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa884ce-604f-48f4-87cd-ebfae405e0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-615394269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ad757f-5991-4ef2-9be3-ef3465098628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dadfe7e7854511a1b2761f5e852b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:10Z,use_quota=True,user_id='920ddaab1548435ca47fc2e5a163a100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9358368c-34c3-4926-9d2e-1f3692938238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9358368c-34c3-4926-9d2e-1f3692938238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f048fe-b878-47ac-9176-2a7e372a5f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f048fe-b878-47ac-9176-2a7e372a5f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34ad757f-5991-4ef2-9be3-ef3465098628', 'volume_name': 'volume-34ad757f-5991-4ef2-9be3-ef3465098628', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca58855-d601-4970-8779-70f7560c8f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca58855-d601-4970-8779-70f7560c8f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdcda0a-0658-4bdf-a80d-f17e48739ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:10 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Volume 34ad757f-5991-4ef2-9be3-ef3465098628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34ad757f-5991-4ef2-9be3-ef3465098628', 'volume_size': 1}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-615394269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ad757f-5991-4ef2-9be3-ef3465098628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89dadfe7e7854511a1b2761f5e852b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:10Z,use_quota=True,user_id='920ddaab1548435ca47fc2e5a163a100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Creating volume 34ad757f-5991-4ef2-9be3-ef3465098628 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:13:10 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-34ad757f-5991-4ef2-9be3-ef3465098628 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:10 devstack sudo[100906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-34ad757f-5991-4ef2-9be3-ef3465098628 1073741824
Sep 25 15:13:10 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:10 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.480s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:13:10 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Deleted volume successfully.
Sep 25 15:13:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-22bcd2a2-5f35-4271-8bea-6268e36a9793 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-ff1f100f-c954-4ab7-a227-2dd5abe8cbd8-delete_volume" released by "delete_volume" :: held 5.449s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-fea195d2-62d1-420a-99d3-f08c7a46f65c-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-fea195d2-62d1-420a-99d3-f08c7a46f65c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "cinder-quobyte-fea195d2-62d1-420a-99d3-f08c7a46f65c" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-fea195d2-62d1-420a-99d3-f08c7a46f65c" acquired by "delete_volume" :: waited 0.042s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:11 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-34ad757f-5991-4ef2-9be3-ef3465098628 1073741824" returned: 0 in 1.026s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd0a5a1-ffbe-4969-b5bd-7873d57c1a72]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fea195d2-62d1-420a-99d3-f08c7a46f65c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-34ad757f-5991-4ef2-9be3-ef3465098628 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:11 devstack sudo[100913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-34ad757f-5991-4ef2-9be3-ef3465098628
Sep 25 15:13:11 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:11 devstack sudo[100912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fea195d2-62d1-420a-99d3-f08c7a46f65c
Sep 25 15:13:11 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:11 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-34ad757f-5991-4ef2-9be3-ef3465098628" returned: 0 in 0.494s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdcda0a-0658-4bdf-a80d-f17e48739ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ad757f-5991-4ef2-9be3-ef3465098628', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a883f95-5b1c-4c2f-bc68-33b03282b70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:11 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Volume volume-34ad757f-5991-4ef2-9be3-ef3465098628 (34ad757f-5991-4ef2-9be3-ef3465098628): created successfully
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a883f95-5b1c-4c2f-bc68-33b03282b70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Flow 'volume_create_manager' (fdcbdba0-217d-457a-a141-c22c7d11dea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:11 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fea195d2-62d1-420a-99d3-f08c7a46f65c" returned: 0 in 0.668s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fea195d2-62d1-420a-99d3-f08c7a46f65c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-97e967b0-4b50-4be2-a288-624398fed6cf tempest-VolumesListAdminTestJSON-537359104 None] Created volume successfully.
Sep 25 15:13:12 devstack sudo[100920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fea195d2-62d1-420a-99d3-f08c7a46f65c
Sep 25 15:13:12 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:12 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-fea195d2-62d1-420a-99d3-f08c7a46f65c" returned: 0 in 0.430s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-quobyte-fea195d2-62d1-420a-99d3-f08c7a46f65c" released by "delete_volume" :: held 1.219s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:12 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Created reservations ['45874479-30fb-4de5-84c0-a0e680229f25', 'fa1bcafc-edf4-4657-9bae-4c624a112b73', '4a78891a-eafd-4bf0-94c4-7e920e2e5dc6', '3ee229c4-e70e-4f24-8517-b98e3a0a6a06'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:13:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:12 devstack sudo[100923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:13:12 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:13 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.395s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:13:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Deleted volume successfully.
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30f0012a-60dd-42f2-8648-9412ea169133 tempest-VolumesDeleteCascade-1312446618 None] Lock "cinder-fea195d2-62d1-420a-99d3-f08c7a46f65c-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Flow 'volume_create_manager' (cbf3b7fd-3337-4028-85a2-e0a5aea749bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6243ce9f-00a6-4c39-b4a4-8cbf5f63f7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6243ce9f-00a6-4c39-b4a4-8cbf5f63f7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ddf26f-a5dd-4fcf-ae84-1f56c62f4706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87df50b277ff4a46bd7cedf3d231706d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:14Z,use_quota=True,user_id='a52796bcbf8a4db9bad022b14a83ea64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a06ddb4-a348-4175-a894-01d32bebdc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a06ddb4-a348-4175-a894-01d32bebdc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce11207-b0de-4fba-adeb-4a3e015b4056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce11207-b0de-4fba-adeb-4a3e015b4056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72ddf26f-a5dd-4fcf-ae84-1f56c62f4706', 'volume_name': 'volume-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76016ae6-d349-4d8f-9a13-50052ceb20d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76016ae6-d349-4d8f-9a13-50052ceb20d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c662736e-e9a1-4085-8590-7149beca9bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:13 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Volume 72ddf26f-a5dd-4fcf-ae84-1f56c62f4706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706', 'volume_size': 1}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ddf26f-a5dd-4fcf-ae84-1f56c62f4706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87df50b277ff4a46bd7cedf3d231706d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:14Z,use_quota=True,user_id='a52796bcbf8a4db9bad022b14a83ea64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Creating volume 72ddf26f-a5dd-4fcf-ae84-1f56c62f4706 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:13:13 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:13:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:13 devstack sudo[100926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706 1073741824
Sep 25 15:13:13 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:14 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706 1073741824" returned: 0 in 0.727s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:14 devstack sudo[100932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706
Sep 25 15:13:14 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:15 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706" returned: 0 in 0.523s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c662736e-e9a1-4085-8590-7149beca9bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8331dc32-0b73-4683-a63e-ef4f4ce9251f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Volume volume-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706 (72ddf26f-a5dd-4fcf-ae84-1f56c62f4706): created successfully
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8331dc32-0b73-4683-a63e-ef4f4ce9251f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Flow 'volume_create_manager' (cbf3b7fd-3337-4028-85a2-e0a5aea749bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-771f715a-929a-4991-a03b-c91ea3a1d484 tempest-VolumesListAdminTestJSON-473406642 None] Created volume successfully.
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Flow 'volume_create_manager' (3c78ca76-d0ab-4786-80a6-9d45ff93f90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15130ee0-8119-427b-bfd7-5be4a0d187b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15130ee0-8119-427b-bfd7-5be4a0d187b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1980402632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ab0c1a-7c96-4767-aed4-b1bb4016c888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4410e07d91a74bc394ac3cbb2e0dee80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:16Z,use_quota=True,user_id='38951778d8284e68ad3f655aedb9ddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a61182-136f-4ee6-a37e-5f0d159c5de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a61182-136f-4ee6-a37e-5f0d159c5de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cf8392-ac94-4357-a51f-3d939a89277a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cf8392-ac94-4357-a51f-3d939a89277a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ab0c1a-7c96-4767-aed4-b1bb4016c888', 'volume_name': 'volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c594eddf-d1e3-4dc7-bfc8-39fcdda7afb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c594eddf-d1e3-4dc7-bfc8-39fcdda7afb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8243240f-3174-4c3c-a801-98e328bfc9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Volume 76ab0c1a-7c96-4767-aed4-b1bb4016c888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888', 'volume_size': 1}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1980402632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ab0c1a-7c96-4767-aed4-b1bb4016c888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4410e07d91a74bc394ac3cbb2e0dee80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:16Z,use_quota=True,user_id='38951778d8284e68ad3f655aedb9ddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Creating volume 76ab0c1a-7c96-4767-aed4-b1bb4016c888 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:13:15 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:13:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:15 devstack sudo[100935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 1073741824
Sep 25 15:13:15 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Acquiring lock "cinder-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Lock "cinder-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Acquiring lock "cinder-quobyte-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Lock "cinder-quobyte-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:16 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cf8b32-f371-44cb-947e-f3781b9c8807]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:13:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Acquiring lock "cinder-34ad757f-5991-4ef2-9be3-ef3465098628-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Lock "cinder-34ad757f-5991-4ef2-9be3-ef3465098628-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Acquiring lock "cinder-quobyte-34ad757f-5991-4ef2-9be3-ef3465098628" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:16 devstack sudo[100940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706
Sep 25 15:13:16 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Lock "cinder-quobyte-34ad757f-5991-4ef2-9be3-ef3465098628" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:16 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cd0695-8ad8-4c7c-839c-a279b8979994]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:13:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-34ad757f-5991-4ef2-9be3-ef3465098628 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:16 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 1073741824" returned: 0 in 0.970s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:16 devstack sudo[100943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-34ad757f-5991-4ef2-9be3-ef3465098628
Sep 25 15:13:16 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:16 devstack sudo[100945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888
Sep 25 15:13:16 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:17 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706" returned: 0 in 0.850s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:17 devstack sudo[100952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706
Sep 25 15:13:17 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:17 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-34ad757f-5991-4ef2-9be3-ef3465098628" returned: 0 in 0.651s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-34ad757f-5991-4ef2-9be3-ef3465098628 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:17 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888" returned: 0 in 0.502s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:13:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:17 devstack sudo[100956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-34ad757f-5991-4ef2-9be3-ef3465098628
Sep 25 15:13:17 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8243240f-3174-4c3c-a801-98e328bfc9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a37570-c6bc-44e0-8c66-351430d04ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:17 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Volume volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 (76ab0c1a-7c96-4767-aed4-b1bb4016c888): created successfully
Sep 25 15:13:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a37570-c6bc-44e0-8c66-351430d04ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Flow 'volume_create_manager' (3c78ca76-d0ab-4786-80a6-9d45ff93f90e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-cda9c390-1867-44a9-aeac-6873ac9e87b9 tempest-TestStampPattern-365617491 None] Created volume successfully.
Sep 25 15:13:17 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706" returned: 0 in 0.587s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Lock "cinder-quobyte-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706" released by "delete_volume" :: held 1.530s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:17 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-34ad757f-5991-4ef2-9be3-ef3465098628" returned: 0 in 0.588s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:17 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Created reservations ['0c8cd4c0-2d40-4599-8a6b-b5f8235a416a', '875dbd6d-8127-406a-a538-f7e1fad2c876', '0305dedb-78bd-453d-89d4-116b4000d3fc', '0b7b4613-cfcb-4f61-8c56-8adfd44cf8ca'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:13:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Lock "cinder-quobyte-34ad757f-5991-4ef2-9be3-ef3465098628" released by "delete_volume" :: held 1.339s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:18 devstack sudo[100964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:13:18 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:18 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Created reservations ['0f7837c5-286e-407b-9169-eec9a6708147', 'dafbc661-10cc-40ba-9c6a-37a9ea5bddb7', '4412b206-72a1-478f-8e09-4bc043e8b50b', '934e790f-6bfa-4664-93df-a6e5d62647dc'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:13:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:18 devstack sudo[100966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:13:18 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:18 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.526s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:18 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:13:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Deleted volume successfully.
Sep 25 15:13:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-96a0aaec-bc47-4d1a-b44d-97d75cb06b3d tempest-VolumesListAdminTestJSON-473406642 None] Lock "cinder-72ddf26f-a5dd-4fcf-ae84-1f56c62f4706-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Acquiring lock "cinder-680869bf-3d2a-4203-8ed9-6f5cd97d2968-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:19 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.642s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:19 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:13:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Lock "cinder-680869bf-3d2a-4203-8ed9-6f5cd97d2968-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:19 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Deleted volume successfully.
Sep 25 15:13:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a82ea645-18b3-436a-86fb-105b4d4c7aab tempest-VolumesListAdminTestJSON-537359104 None] Lock "cinder-34ad757f-5991-4ef2-9be3-ef3465098628-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Acquiring lock "cinder-quobyte-680869bf-3d2a-4203-8ed9-6f5cd97d2968" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Lock "cinder-quobyte-680869bf-3d2a-4203-8ed9-6f5cd97d2968" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7834dafa-1612-4a48-a612-e65df0d97fec]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:13:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-680869bf-3d2a-4203-8ed9-6f5cd97d2968 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:19 devstack sudo[100971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-680869bf-3d2a-4203-8ed9-6f5cd97d2968
Sep 25 15:13:19 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:20 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-680869bf-3d2a-4203-8ed9-6f5cd97d2968" returned: 0 in 0.718s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-680869bf-3d2a-4203-8ed9-6f5cd97d2968 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:20 devstack sudo[100976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-680869bf-3d2a-4203-8ed9-6f5cd97d2968
Sep 25 15:13:20 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:20 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-680869bf-3d2a-4203-8ed9-6f5cd97d2968" returned: 0 in 0.399s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Lock "cinder-quobyte-680869bf-3d2a-4203-8ed9-6f5cd97d2968" released by "delete_volume" :: held 1.217s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Created reservations ['15511c3e-2c14-49c1-b610-e50845b9fd9b', '04ac7a5b-3fc9-47ea-9673-7ba3afb98aab', '7d97703c-63a6-492e-b868-682be5cc377a', '39296b9b-39df-4a49-aa38-98f7518846cd'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:20 devstack sudo[100979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:13:20 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:20 devstack sudo[100980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:13:20 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:21 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.815s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:13:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Deleted volume successfully.
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:13:21 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Flow 'volume_create_manager' (b6582771-a3c3-4b10-a39a-bb30fdf1329c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6811c6-6953-4c93-943d-e0c5242f52bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.892s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 28 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6811c6-6953-4c93-943d-e0c5242f52bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1699947110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bca0d12-22ff-4a85-8807-26f312c18a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46f1ebb6c904214b8370992bfb5f707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:22Z,use_quota=True,user_id='1643e6b5c0e04db2b868958bf5f93fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce59562-be52-4656-8534-738ad9bc8bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce59562-be52-4656-8534-738ad9bc8bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3355176-96fd-43c5-a56c-31813e79b5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3355176-96fd-43c5-a56c-31813e79b5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bca0d12-22ff-4a85-8807-26f312c18a19', 'volume_name': 'volume-6bca0d12-22ff-4a85-8807-26f312c18a19', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e38029-771e-4b5a-8ea0-59791cb2223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e38029-771e-4b5a-8ea0-59791cb2223e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795ff09c-cf48-4762-ada0-4885bd49c307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:21 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Volume 6bca0d12-22ff-4a85-8807-26f312c18a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bca0d12-22ff-4a85-8807-26f312c18a19', 'volume_size': 1}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1699947110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bca0d12-22ff-4a85-8807-26f312c18a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46f1ebb6c904214b8370992bfb5f707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:22Z,use_quota=True,user_id='1643e6b5c0e04db2b868958bf5f93fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Creating volume 6bca0d12-22ff-4a85-8807-26f312c18a19 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:13:21 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6bca0d12-22ff-4a85-8807-26f312c18a19 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf0bdb40-d40e-4fbe-b8d7-11eec5103427 tempest-VolumesListAdminTestJSON-537359104 None] Lock "cinder-680869bf-3d2a-4203-8ed9-6f5cd97d2968-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Acquiring lock "cinder-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:21 devstack sudo[100998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6bca0d12-22ff-4a85-8807-26f312c18a19 1073741824
Sep 25 15:13:21 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Lock "cinder-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Acquiring lock "cinder-quobyte-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Lock "cinder-quobyte-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa" acquired by "delete_volume" :: waited 0.038s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:22 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[34541a97-65ae-47b9-a864-f63c62cd378b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:13:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:22 devstack sudo[101002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa
Sep 25 15:13:22 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:22 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6bca0d12-22ff-4a85-8807-26f312c18a19 1073741824" returned: 0 in 0.813s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:22 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6bca0d12-22ff-4a85-8807-26f312c18a19 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa" returned: 0 in 0.648s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:22 devstack sudo[101011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6bca0d12-22ff-4a85-8807-26f312c18a19
Sep 25 15:13:22 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:22 devstack sudo[101012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa
Sep 25 15:13:22 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:23 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa" returned: 0 in 0.382s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:23 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Lock "cinder-quobyte-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa" released by "delete_volume" :: held 1.113s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6bca0d12-22ff-4a85-8807-26f312c18a19" returned: 0 in 0.440s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795ff09c-cf48-4762-ada0-4885bd49c307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bca0d12-22ff-4a85-8807-26f312c18a19', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67065bb-d657-4a43-95c6-0fe3af791c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:23 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Volume volume-6bca0d12-22ff-4a85-8807-26f312c18a19 (6bca0d12-22ff-4a85-8807-26f312c18a19): created successfully
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67065bb-d657-4a43-95c6-0fe3af791c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Flow 'volume_create_manager' (b6582771-a3c3-4b10-a39a-bb30fdf1329c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-08a4f627-d8e9-491d-a33d-f306cc68ba32 tempest-VolumesMetadataTest-639733996 None] Created volume successfully.
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Created reservations ['3400cce7-10ae-462e-84a7-58197e5a6e96', 'b880b5f3-f9c7-4200-8246-f27d61c9f7f7', '5c6cff81-058b-401a-9c74-048621ee900c', 'b9566811-54a8-49d6-b30f-b5816d681154'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:23 devstack sudo[101017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:13:23 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:23 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.357s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:13:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Deleted volume successfully.
Sep 25 15:13:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d7b7754c-0201-4ea9-baac-bbf96d9474de tempest-VolumesListAdminTestJSON-537359104 None] Lock "cinder-5049b408-e2ec-40ba-a6b3-ffa909bbf6fa-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Acquiring lock "cinder-6bca0d12-22ff-4a85-8807-26f312c18a19-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Lock "cinder-6bca0d12-22ff-4a85-8807-26f312c18a19-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Acquiring lock "cinder-quobyte-6bca0d12-22ff-4a85-8807-26f312c18a19" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Lock "cinder-quobyte-6bca0d12-22ff-4a85-8807-26f312c18a19" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:25 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bd5589-d69f-4041-b678-c8cacbe5976f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:13:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6bca0d12-22ff-4a85-8807-26f312c18a19 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:25 devstack sudo[101020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6bca0d12-22ff-4a85-8807-26f312c18a19
Sep 25 15:13:25 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:25 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6bca0d12-22ff-4a85-8807-26f312c18a19" returned: 0 in 0.591s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6bca0d12-22ff-4a85-8807-26f312c18a19 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:26 devstack sudo[101025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6bca0d12-22ff-4a85-8807-26f312c18a19
Sep 25 15:13:26 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:26 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6bca0d12-22ff-4a85-8807-26f312c18a19" returned: 0 in 0.395s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Lock "cinder-quobyte-6bca0d12-22ff-4a85-8807-26f312c18a19" released by "delete_volume" :: held 1.063s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:26 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Created reservations ['a1e0da10-c662-4931-9300-e178115c8597', '72f20614-4c99-4728-b0bd-85a8a7077a03', 'e2771bf7-ff8d-406a-bbbc-89cc1d3e01f4', '3951f70e-a5db-4340-8f93-c17a5c3f49de'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:13:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:26 devstack sudo[101028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:13:26 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:26 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.328s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:26 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:13:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Deleted volume successfully.
Sep 25 15:13:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9f44abaa-151a-45f3-a0fc-a78341769a29 tempest-VolumesMetadataTest-639733996 None] Lock "cinder-6bca0d12-22ff-4a85-8807-26f312c18a19-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:36 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=52,cinder:UPDATE=84,cinder:INSERT=17,cinder:DELETE=6 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:13:36 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=55,cinder:UPDATE=80,cinder:DELETE=8,cinder:INSERT=22 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Flow 'volume_create_manager' (39c473d5-7ffa-437f-9e04-d00bdd72136b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc76be2-f1b0-45b8-be04-336c60c233e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc76be2-f1b0-45b8-be04-336c60c233e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-275430375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5396490-2a10-44e7-ae65-0d443fe5862f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8a05f1c4cf3497099c66dd64d657da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:41Z,use_quota=True,user_id='aaec2277dca848b3ba3a098e8890c060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd05c1d-f440-4f7f-8c80-8dfaee1ec39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd05c1d-f440-4f7f-8c80-8dfaee1ec39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87fbc9f-d2e3-4f44-b525-70f9e58d08bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87fbc9f-d2e3-4f44-b525-70f9e58d08bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5396490-2a10-44e7-ae65-0d443fe5862f', 'volume_name': 'volume-b5396490-2a10-44e7-ae65-0d443fe5862f', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6e1ae3-19f5-40e9-a44c-c0dce345a70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6e1ae3-19f5-40e9-a44c-c0dce345a70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a8b504-dada-4f51-aa25-bc28336410b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:41 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Volume b5396490-2a10-44e7-ae65-0d443fe5862f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5396490-2a10-44e7-ae65-0d443fe5862f', 'volume_size': 1}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-275430375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5396490-2a10-44e7-ae65-0d443fe5862f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8a05f1c4cf3497099c66dd64d657da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:41Z,use_quota=True,user_id='aaec2277dca848b3ba3a098e8890c060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Creating volume b5396490-2a10-44e7-ae65-0d443fe5862f {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:13:41 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:13:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5396490-2a10-44e7-ae65-0d443fe5862f 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:41 devstack sudo[101118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5396490-2a10-44e7-ae65-0d443fe5862f 1073741824
Sep 25 15:13:41 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:42 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5396490-2a10-44e7-ae65-0d443fe5862f 1073741824" returned: 0 in 0.992s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5396490-2a10-44e7-ae65-0d443fe5862f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:42 devstack sudo[101123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5396490-2a10-44e7-ae65-0d443fe5862f
Sep 25 15:13:42 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:42 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5396490-2a10-44e7-ae65-0d443fe5862f" returned: 0 in 0.552s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:13:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a8b504-dada-4f51-aa25-bc28336410b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5396490-2a10-44e7-ae65-0d443fe5862f', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d90d76b-c788-4b4b-a425-93adfc36c3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Volume volume-b5396490-2a10-44e7-ae65-0d443fe5862f (b5396490-2a10-44e7-ae65-0d443fe5862f): created successfully
Sep 25 15:13:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d90d76b-c788-4b4b-a425-93adfc36c3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Flow 'volume_create_manager' (39c473d5-7ffa-437f-9e04-d00bdd72136b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8d897b93-3dcf-4388-b0d7-05484f67d8c6 tempest-VolumesTransfersTest-1441455991 None] Created volume successfully.
Sep 25 15:13:44 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1ba5d19b-879d-4b20-831f-d7f01b6062ed tempest-VolumesTransfersTest-1972888340 None] Transfer volume completed successfully.
Sep 25 15:13:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Acquiring lock "cinder-b5396490-2a10-44e7-ae65-0d443fe5862f-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Lock "cinder-b5396490-2a10-44e7-ae65-0d443fe5862f-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Acquiring lock "cinder-quobyte-b5396490-2a10-44e7-ae65-0d443fe5862f" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Lock "cinder-quobyte-b5396490-2a10-44e7-ae65-0d443fe5862f" acquired by "delete_volume" :: waited 0.046s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:46 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e08b806-11d7-490d-90ac-7b9bc2f93226]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:13:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5396490-2a10-44e7-ae65-0d443fe5862f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:46 devstack sudo[101128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5396490-2a10-44e7-ae65-0d443fe5862f
Sep 25 15:13:46 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:47 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5396490-2a10-44e7-ae65-0d443fe5862f" returned: 0 in 0.882s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5396490-2a10-44e7-ae65-0d443fe5862f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:47 devstack sudo[101133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5396490-2a10-44e7-ae65-0d443fe5862f
Sep 25 15:13:47 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:47 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b5396490-2a10-44e7-ae65-0d443fe5862f" returned: 0 in 0.474s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Lock "cinder-quobyte-b5396490-2a10-44e7-ae65-0d443fe5862f" released by "delete_volume" :: held 1.466s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:47 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Created reservations ['43de6e11-b4e3-40cb-86fd-6eae6fc5020c', '6f236504-63ce-4406-bdd3-b4bec0e4e1ab', '20fc418b-44aa-4000-9ce9-15e62cfed977', 'ba2b542c-9b53-4814-9a2c-65411b1041f1'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:13:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:48 devstack sudo[101137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:13:48 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:48 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.624s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:48 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:13:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Deleted volume successfully.
Sep 25 15:13:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8407198b-ecdf-467a-9cb0-8579ed583af6 tempest-VolumesTransfersTest-450282754 None] Lock "cinder-b5396490-2a10-44e7-ae65-0d443fe5862f-delete_volume" released by "delete_volume" :: held 2.714s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Flow 'volume_create_manager' (f5c30520-d672-4978-9215-94421dfab33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1929feeb-fef9-47e8-ba02-a75da1107dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1929feeb-fef9-47e8-ba02-a75da1107dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1194978212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dfea1dd-82ce-45dc-a543-717be970f7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8a05f1c4cf3497099c66dd64d657da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:49Z,use_quota=True,user_id='aaec2277dca848b3ba3a098e8890c060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01dbcbc2-26d5-4121-9412-7e50176c74e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01dbcbc2-26d5-4121-9412-7e50176c74e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a4ad4f-3c1c-4508-aff3-89d837e71379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a4ad4f-3c1c-4508-aff3-89d837e71379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dfea1dd-82ce-45dc-a543-717be970f7ba', 'volume_name': 'volume-5dfea1dd-82ce-45dc-a543-717be970f7ba', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742469c7-7220-49e9-9c2c-bf45ef381e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742469c7-7220-49e9-9c2c-bf45ef381e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b885073-834f-4c5b-9d65-7cb77356ccc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:49 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Volume 5dfea1dd-82ce-45dc-a543-717be970f7ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dfea1dd-82ce-45dc-a543-717be970f7ba', 'volume_size': 1}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1194978212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dfea1dd-82ce-45dc-a543-717be970f7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8a05f1c4cf3497099c66dd64d657da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:49Z,use_quota=True,user_id='aaec2277dca848b3ba3a098e8890c060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Creating volume 5dfea1dd-82ce-45dc-a543-717be970f7ba {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:13:49 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:13:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5dfea1dd-82ce-45dc-a543-717be970f7ba 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:49 devstack sudo[101169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5dfea1dd-82ce-45dc-a543-717be970f7ba 1073741824
Sep 25 15:13:49 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:50 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5dfea1dd-82ce-45dc-a543-717be970f7ba 1073741824" returned: 0 in 0.645s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5dfea1dd-82ce-45dc-a543-717be970f7ba {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:50 devstack sudo[101176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5dfea1dd-82ce-45dc-a543-717be970f7ba
Sep 25 15:13:50 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:50 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5dfea1dd-82ce-45dc-a543-717be970f7ba" returned: 0 in 0.420s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b885073-834f-4c5b-9d65-7cb77356ccc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dfea1dd-82ce-45dc-a543-717be970f7ba', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c546a68-d799-4772-b6c4-761e7bbdd161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:50 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Volume volume-5dfea1dd-82ce-45dc-a543-717be970f7ba (5dfea1dd-82ce-45dc-a543-717be970f7ba): created successfully
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c546a68-d799-4772-b6c4-761e7bbdd161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Flow 'volume_create_manager' (f5c30520-d672-4978-9215-94421dfab33d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c4816650-25e0-41e5-ba4c-df1cf5ff6316 tempest-VolumesTransfersTest-1441455991 None] Created volume successfully.
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Flow 'volume_create_manager' (b4a9e1a0-3dba-4322-b6fe-f7a97ab550c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3f463c-514a-404b-94d9-30a2d53b058f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3f463c-514a-404b-94d9-30a2d53b058f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-553328882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60609702-39c7-474e-970e-5dd185be9b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e6b7f47a284c3b98b5ac0e05811610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:51Z,use_quota=True,user_id='6af833712f464068842c332759446d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccf9e3a-696a-41b5-8a50-0b013f13c95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccf9e3a-696a-41b5-8a50-0b013f13c95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3d2732-ead8-4d57-aa88-4645a636adb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:50 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 15:13:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3d2732-ead8-4d57-aa88-4645a636adb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '60609702-39c7-474e-970e-5dd185be9b22', 'volume_name': 'volume-60609702-39c7-474e-970e-5dd185be9b22', 'volume_size': 1, 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd97dcba93bf843d9acf4a870a4730210', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'created_at': datetime.datetime(2026, 9, 25, 12, 52, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 52, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a354fa4c-98b3-48a7-8483-e976ebf152bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76381b9b1190>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d899481-987f-474c-a2ab-10db053d6fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d899481-987f-474c-a2ab-10db053d6fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a90d65e-032e-447e-836f-30d5df998a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:51 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Volume 60609702-39c7-474e-970e-5dd185be9b22: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-60609702-39c7-474e-970e-5dd185be9b22', 'volume_size': 1, 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd97dcba93bf843d9acf4a870a4730210', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'created_at': datetime.datetime(2026, 9, 25, 12, 52, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 52, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a354fa4c-98b3-48a7-8483-e976ebf152bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76381b9b1190>}
Sep 25 15:13:51 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Trying to clone 60609702-39c7-474e-970e-5dd185be9b22 from image a354fa4c-98b3-48a7-8483-e976ebf152bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 15:13:51 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_bj7t67jpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 15:13:51 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 15:13:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa985b9-9959-4ccd-98b7-31ebed203106]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:13:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_bj7t67jpdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:51 devstack sudo[101180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_bj7t67jpdevstack@QuobyteHD
Sep 25 15:13:51 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Acquiring lock "cinder-5dfea1dd-82ce-45dc-a543-717be970f7ba-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:52 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_bj7t67jpdevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Temporary image a354fa4c-98b3-48a7-8483-e976ebf152bc is fetched for user 6af833712f464068842c332759446d72. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Lock "cinder-5dfea1dd-82ce-45dc-a543-717be970f7ba-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Acquiring lock "cinder-quobyte-5dfea1dd-82ce-45dc-a543-717be970f7ba" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Lock "cinder-quobyte-5dfea1dd-82ce-45dc-a543-717be970f7ba" acquired by "delete_volume" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Flow 'volume_create_manager' (1a543c30-9967-4721-9bbc-37835293609d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86a6453-0ebb-4f6b-9031-35e2263ed3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0bcc77-e954-4b1a-87b6-b3a359b2ad16]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5dfea1dd-82ce-45dc-a543-717be970f7ba {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78c15b2-2b08-45e5-ba2f-323704a95639]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_bj7t67jpdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86a6453-0ebb-4f6b-9031-35e2263ed3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2120977150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5121ee7-c82c-49f7-a7f9-86cbdd203d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0047e58b0b5143f2a2e005ee3d631bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:52Z,use_quota=True,user_id='4af133abc7e14a25b07f6d516568370f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9361817-c6d1-4548-a4c8-d19606cda6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9361817-c6d1-4548-a4c8-d19606cda6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0f5372-7d6e-42dc-ba0f-7c4e689db465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0f5372-7d6e-42dc-ba0f-7c4e689db465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5121ee7-c82c-49f7-a7f9-86cbdd203d91', 'volume_name': 'volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4459f25-878f-4836-98ed-aa444843a3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4459f25-878f-4836-98ed-aa444843a3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff6fee2-ba12-4c04-a740-ae058673d64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:52 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Volume e5121ee7-c82c-49f7-a7f9-86cbdd203d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91', 'volume_size': 1}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2120977150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5121ee7-c82c-49f7-a7f9-86cbdd203d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0047e58b0b5143f2a2e005ee3d631bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:52Z,use_quota=True,user_id='4af133abc7e14a25b07f6d516568370f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Creating volume e5121ee7-c82c-49f7-a7f9-86cbdd203d91 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:13:52 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:52 devstack sudo[101187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 1073741824
Sep 25 15:13:52 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:52 devstack sudo[101185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5dfea1dd-82ce-45dc-a543-717be970f7ba
Sep 25 15:13:52 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:52 devstack sudo[101186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_bj7t67jpdevstack@QuobyteHD
Sep 25 15:13:52 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:52 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5dfea1dd-82ce-45dc-a543-717be970f7ba" returned: 0 in 0.425s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5dfea1dd-82ce-45dc-a543-717be970f7ba {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:52 devstack sudo[101199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5dfea1dd-82ce-45dc-a543-717be970f7ba
Sep 25 15:13:52 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:52 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_bj7t67jpdevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:53 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 1073741824" returned: 0 in 0.569s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:53 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5dfea1dd-82ce-45dc-a543-717be970f7ba" returned: 0 in 0.296s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:53 devstack sudo[101206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91
Sep 25 15:13:53 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Lock "cinder-quobyte-5dfea1dd-82ce-45dc-a543-717be970f7ba" released by "delete_volume" :: held 0.802s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Created reservations ['e4608f7e-2e21-4495-83aa-7cca480162c2', '1d7c728a-3a68-4298-85ab-eca44349e8e1', '6c5de88c-d7a3-4c7b-bcc6-46b3bd711019', 'f084c38d-007f-4275-812e-79d158ab0ac6'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:53 devstack sudo[101208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:13:53 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:53 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91" returned: 0 in 0.456s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.655s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-553328882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60609702-39c7-474e-970e-5dd185be9b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e6b7f47a284c3b98b5ac0e05811610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:13:51Z,use_quota=True,user_id='6af833712f464068842c332759446d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Creating volume 60609702-39c7-474e-970e-5dd185be9b22 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:13:53 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff6fee2-ba12-4c04-a740-ae058673d64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab4c9ef-92c5-4aa7-a36e-6719ee3f24fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:53 devstack sudo[101212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22 1073741824
Sep 25 15:13:53 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:53 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Volume volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 (e5121ee7-c82c-49f7-a7f9-86cbdd203d91): created successfully
Sep 25 15:13:53 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab4c9ef-92c5-4aa7-a36e-6719ee3f24fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Flow 'volume_create_manager' (1a543c30-9967-4721-9bbc-37835293609d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.367s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:13:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Deleted volume successfully.
Sep 25 15:13:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fd958aa2-3367-4315-acac-a1a2836e02a8 tempest-SnapshotDependencyTests-1013833494 None] Created volume successfully.
Sep 25 15:13:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b385c0a7-bcf5-468b-ac5d-da850868f48b tempest-VolumesTransfersTest-450282754 None] Lock "cinder-5dfea1dd-82ce-45dc-a543-717be970f7ba-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:13:54 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22 1073741824" returned: 0 in 0.674s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:54 devstack sudo[101218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22
Sep 25 15:13:54 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:54 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22" returned: 0 in 0.381s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:13:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:54 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Attempting download of a354fa4c-98b3-48a7-8483-e976ebf152bc ((None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}])) to volume 60609702-39c7-474e-970e-5dd185be9b22. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 15:13:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:13:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:13:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] Creating offline snapshot ede46442-3d7a-4004-8a5f-3e01140e4f0b of volume e5121ee7-c82c-49f7-a7f9-86cbdd203d91 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:13:54 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cca1ebe-37ea-46ca-88c0-7af3543a56f6]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:13:54 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[248b3102-6bba-41e3-a2b9-915ac36624e4]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:13:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_kjeo4gce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:55 devstack sudo[101221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91
Sep 25 15:13:55 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:55 devstack sudo[101222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_kjeo4gce
Sep 25 15:13:55 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:55 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_kjeo4gce" returned: 0 in 0.436s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_kjeo4gce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:55 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91" returned: 0 in 0.552s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:55 devstack sudo[101238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b 1G
Sep 25 15:13:55 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:55 devstack sudo[101235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_kjeo4gce
Sep 25 15:13:55 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:55 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_kjeo4gce" returned: 1 in 0.574s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_kjeo4gce' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:13:55 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a995da70-26e0-4d71-ad6d-379f44d2574d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:13:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_bj7t67jpdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:56 devstack sudo[101246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_bj7t67jpdevstack@QuobyteHD
Sep 25 15:13:56 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:56 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b 1G" returned: 0 in 0.764s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:56 devstack sudo[101251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b
Sep 25 15:13:56 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:56 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_bj7t67jpdevstack@QuobyteHD" returned: 0 in 0.695s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:56 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] a354fa4c-98b3-48a7-8483-e976ebf152bc was qcow2, converting to qcow2 {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 15:13:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_bj7t67jpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:56 devstack sudo[101257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_bj7t67jpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22
Sep 25 15:13:56 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:56 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b" returned: 0 in 0.684s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:56 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b is being set with open permissions: ugo+rw
Sep 25 15:13:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:56 devstack sudo[101262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b
Sep 25 15:13:56 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:57 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b" returned: 0 in 0.409s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:57 devstack sudo[101269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.info
Sep 25 15:13:57 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:57 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.info" returned: 0 in 0.524s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:57 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.info is being set with open permissions: ugo+rw
Sep 25 15:13:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:57 devstack sudo[101275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.info
Sep 25 15:13:57 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:58 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.info" returned: 0 in 0.434s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.513s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:13:58 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f67d0adb-711c-49eb-98c6-bc07443c9c2a tempest-SnapshotDependencyTests-1013833494 None] Create snapshot completed successfully
Sep 25 15:13:59 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_bj7t67jpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22" returned: 0 in 2.666s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:59 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_bj7t67jpdevstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:13:59 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Converted 112.00 MB image at 41.99 MB/s
Sep 25 15:13:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:13:59 devstack sudo[101278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22 1G
Sep 25 15:13:59 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:13:59 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root
Sep 25 15:13:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22 1G" returned: 0 in 0.506s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:13:59 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Downloaded image a354fa4c-98b3-48a7-8483-e976ebf152bc ((None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}])) to volume 60609702-39c7-474e-970e-5dd185be9b22 successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 15:13:59 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Temporary image a354fa4c-98b3-48a7-8483-e976ebf152bc for user 6af833712f464068842c332759446d72 is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 15:13:59 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Marking volume 60609702-39c7-474e-970e-5dd185be9b22 as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 15:13:59 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Copying metadata from image a354fa4c-98b3-48a7-8483-e976ebf152bc to 60609702-39c7-474e-970e-5dd185be9b22. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 15:13:59 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Creating volume glance metadata for volume 60609702-39c7-474e-970e-5dd185be9b22 backed by image a354fa4c-98b3-48a7-8483-e976ebf152bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 15:13:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a90d65e-032e-447e-836f-30d5df998a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60609702-39c7-474e-970e-5dd185be9b22', 'volume_size': 1, 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd97dcba93bf843d9acf4a870a4730210', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'created_at': datetime.datetime(2026, 9, 25, 12, 52, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 52, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a354fa4c-98b3-48a7-8483-e976ebf152bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76381b9b1190>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7550153-1dc0-49ab-be78-6c5e56a4eab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:13:59 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Volume volume-60609702-39c7-474e-970e-5dd185be9b22 (60609702-39c7-474e-970e-5dd185be9b22): created successfully
Sep 25 15:13:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7550153-1dc0-49ab-be78-6c5e56a4eab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:13:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Flow 'volume_create_manager' (b4a9e1a0-3dba-4322-b6fe-f7a97ab550c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:14:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6b95ec6e-49b9-48bb-adb8-a5503ce4c0da tempest-VolumesImageMetadata-1394546967 None] Created volume successfully.
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Flow 'volume_create_manager' (332996e3-379a-477d-8062-9398c4453888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b77a63-8d78-488c-8646-b2663804699c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b77a63-8d78-488c-8646-b2663804699c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1349b69d-8066-4926-930a-5475ad443ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0047e58b0b5143f2a2e005ee3d631bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ede46442-3d7a-4004-8a5f-3e01140e4f0b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:14:00Z,use_quota=True,user_id='4af133abc7e14a25b07f6d516568370f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2bd395-5d23-4aff-a3c7-9aaae274c9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2bd395-5d23-4aff-a3c7-9aaae274c9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea55d84-b2ee-4841-9d03-168530ba3694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea55d84-b2ee-4841-9d03-168530ba3694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1349b69d-8066-4926-930a-5475ad443ba2', 'volume_name': 'volume-1349b69d-8066-4926-930a-5475ad443ba2', 'volume_size': 1, 'snapshot_id': 'ede46442-3d7a-4004-8a5f-3e01140e4f0b'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab3c37f-e713-4151-a4b4-b54303ad1e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab3c37f-e713-4151-a4b4-b54303ad1e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcefa149-94f5-4e79-a072-f345cbedf008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:00 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Volume 1349b69d-8066-4926-930a-5475ad443ba2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1349b69d-8066-4926-930a-5475ad443ba2', 'volume_size': 1, 'snapshot_id': 'ede46442-3d7a-4004-8a5f-3e01140e4f0b'}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "cinder-quobyte-ede46442-3d7a-4004-8a5f-3e01140e4f0b-1349b69d-8066-4926-930a-5475ad443ba2" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-quobyte-ede46442-3d7a-4004-8a5f-3e01140e4f0b-1349b69d-8066-4926-930a-5475ad443ba2" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Creating volume 1349b69d-8066-4926-930a-5475ad443ba2 from snapshot ede46442-3d7a-4004-8a5f-3e01140e4f0b {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "cinder-quobyte-1349b69d-8066-4926-930a-5475ad443ba2" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-quobyte-1349b69d-8066-4926-930a-5475ad443ba2" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] snapshot: ede46442-3d7a-4004-8a5f-3e01140e4f0b, volume: 1349b69d-8066-4926-930a-5475ad443ba2,  {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6137db57-87db-49c8-9ddc-654395a7617a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:00 devstack sudo[101283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b
Sep 25 15:14:00 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:00 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b" returned: 0 in 0.497s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a861e24-cc33-40ab-b5f3-a33634626b61]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:14:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:00 devstack sudo[101289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91
Sep 25 15:14:00 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:01 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91" returned: 0 in 0.470s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 15:14:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 15:14:01 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Path /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1349b69d-8066-4926-930a-5475ad443ba2 not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 15:14:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1349b69d-8066-4926-930a-5475ad443ba2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:01 devstack sudo[101294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1349b69d-8066-4926-930a-5475ad443ba2
Sep 25 15:14:01 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Acquiring lock "cinder-60609702-39c7-474e-970e-5dd185be9b22-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Lock "cinder-60609702-39c7-474e-970e-5dd185be9b22-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Acquiring lock "cinder-quobyte-60609702-39c7-474e-970e-5dd185be9b22" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Lock "cinder-quobyte-60609702-39c7-474e-970e-5dd185be9b22" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:01 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b4aed7-44ff-46cb-8ead-f0372bbc9cf3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:14:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:01 devstack sudo[101299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22
Sep 25 15:14:01 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:02 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22" returned: 0 in 1.040s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:02 devstack sudo[101347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22
Sep 25 15:14:02 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:03 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-60609702-39c7-474e-970e-5dd185be9b22" returned: 0 in 0.731s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Lock "cinder-quobyte-60609702-39c7-474e-970e-5dd185be9b22" released by "delete_volume" :: held 1.881s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:03 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Created reservations ['7c95971b-b2eb-488d-901e-f9c9cc016683', '42252f1a-2646-461a-9325-473543e3faec', '0b08980c-891e-4d7f-808d-d475a15bce3a', '8bc18f56-92f7-42a3-a1c5-b3b18cb7929c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:14:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:14:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:14:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:04 devstack sudo[101357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:14:04 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:04 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.815s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:04 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:14:04 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Deleted volume successfully.
Sep 25 15:14:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d8af39de-7e56-46c2-b166-0b732021f8e9 tempest-VolumesImageMetadata-1394546967 None] Lock "cinder-60609702-39c7-474e-970e-5dd185be9b22-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-7e596d78-e084-4e67-a082-b090690938c4 req-2c595a94-a991-4b1f-a3ae-08553d0e2744 tempest-TestStampPattern-365617491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:11 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1349b69d-8066-4926-930a-5475ad443ba2" returned: 0 in 10.001s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:11 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Image conversion details: src /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91, size 1024.00 MB, duration 10.00 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1349b69d-8066-4926-930a-5475ad443ba2 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:14:11 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Converted 1024.00 MB image at 102.39 MB/s
Sep 25 15:14:11 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1349b69d-8066-4926-930a-5475ad443ba2 is being set with open permissions: ugo+rw
Sep 25 15:14:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1349b69d-8066-4926-930a-5475ad443ba2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:11 devstack sudo[101369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1349b69d-8066-4926-930a-5475ad443ba2
Sep 25 15:14:11 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:11 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1349b69d-8066-4926-930a-5475ad443ba2" returned: 0 in 0.350s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-quobyte-1349b69d-8066-4926-930a-5475ad443ba2" released by "_copy_volume_from_snapshot" :: held 11.448s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-quobyte-ede46442-3d7a-4004-8a5f-3e01140e4f0b-1349b69d-8066-4926-930a-5475ad443ba2" released by "_create_volume_from_snapshot" :: held 11.533s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.557s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-7e596d78-e084-4e67-a082-b090690938c4 req-2c595a94-a991-4b1f-a3ae-08553d0e2744 tempest-TestStampPattern-365617491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-7e596d78-e084-4e67-a082-b090690938c4 req-2c595a94-a991-4b1f-a3ae-08553d0e2744 tempest-TestStampPattern-365617491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcefa149-94f5-4e79-a072-f345cbedf008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1349b69d-8066-4926-930a-5475ad443ba2', 'volume_size': 1, 'snapshot_id': 'ede46442-3d7a-4004-8a5f-3e01140e4f0b'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324307f0-53d0-4579-a820-5e9a4892ff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:11 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Volume volume-1349b69d-8066-4926-930a-5475ad443ba2 (1349b69d-8066-4926-930a-5475ad443ba2): created successfully
Sep 25 15:14:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324307f0-53d0-4579-a820-5e9a4892ff77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Flow 'volume_create_manager' (332996e3-379a-477d-8062-9398c4453888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:14:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-7e596d78-e084-4e67-a082-b090690938c4 req-2c595a94-a991-4b1f-a3ae-08553d0e2744 tempest-TestStampPattern-365617491 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb0a54b1-063f-4668-be22-4e074e86c362', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:14:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b1542d3a-62fc-43a9-a71f-6df2fb9b3ab0 tempest-SnapshotDependencyTests-1013833494 None] Created volume successfully.
Sep 25 15:14:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-7e596d78-e084-4e67-a082-b090690938c4 req-2c595a94-a991-4b1f-a3ae-08553d0e2744 tempest-TestStampPattern-365617491 None] attachment_update completed successfully.
Sep 25 15:14:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "cinder-ede46442-3d7a-4004-8a5f-3e01140e4f0b-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-ede46442-3d7a-4004-8a5f-3e01140e4f0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "cinder-quobyte-e5121ee7-c82c-49f7-a7f9-86cbdd203d91" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-quobyte-e5121ee7-c82c-49f7-a7f9-86cbdd203d91" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "cinder-quobyte-ede46442-3d7a-4004-8a5f-3e01140e4f0b" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-quobyte-ede46442-3d7a-4004-8a5f-3e01140e4f0b" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Deleting offline snapshot ede46442-3d7a-4004-8a5f-3e01140e4f0b of volume e5121ee7-c82c-49f7-a7f9-86cbdd203d91 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:14:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] snapshot_file for this snap is: volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:14:12 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c773a636-3211-40a8-95b7-346501b1628e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:14:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:13 devstack sudo[101787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b
Sep 25 15:14:13 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:13 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b" returned: 0 in 0.646s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:14:13 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e9785a-3838-4ff4-bb37-1d9ac9c2accc]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:14:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:13 devstack sudo[101792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91
Sep 25 15:14:13 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:14 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91" returned: 0 in 0.827s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:14 devstack sudo[101801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b
Sep 25 15:14:14 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:14 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:14:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Flow 'volume_create_manager' (c4313f07-ad43-4791-ba62-6c62f620ad1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:14:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5f2372-61fe-49f2-9db1-3a46faf07e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5f2372-61fe-49f2-9db1-3a46faf07e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-188401633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb47804-7aaa-4f9c-8914-b3a760cc2bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09981669d1143eaa83e1a4eac97500e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:14:15Z,use_quota=True,user_id='3cb86f487a0c422593931c3f1dbe3cc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3c668e-9338-4708-afba-4f3e632a092a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3c668e-9338-4708-afba-4f3e632a092a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe86f13-efa0-41f1-91b1-9a05ca481565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe86f13-efa0-41f1-91b1-9a05ca481565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eb47804-7aaa-4f9c-8914-b3a760cc2bd2', 'volume_name': 'volume-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dddbf5fd-a347-4a99-bae0-fae5fcc9dbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dddbf5fd-a347-4a99-bae0-fae5fcc9dbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e1fe60-d6ae-4b9e-ba23-069059960203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Volume 4eb47804-7aaa-4f9c-8914-b3a760cc2bd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2', 'volume_size': 1}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-188401633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb47804-7aaa-4f9c-8914-b3a760cc2bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09981669d1143eaa83e1a4eac97500e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:14:15Z,use_quota=True,user_id='3cb86f487a0c422593931c3f1dbe3cc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Creating volume 4eb47804-7aaa-4f9c-8914-b3a760cc2bd2 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:14:15 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:15 devstack sudo[101813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2 1073741824
Sep 25 15:14:15 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:15 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b" returned: 0 in 0.616s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:15 devstack sudo[101815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b
Sep 25 15:14:15 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:15 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91.ede46442-3d7a-4004-8a5f-3e01140e4f0b" returned: 0 in 0.412s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-quobyte-ede46442-3d7a-4004-8a5f-3e01140e4f0b" released by "_delete_snapshot" :: held 2.729s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-quobyte-e5121ee7-c82c-49f7-a7f9-86cbdd203d91" released by "delete_snapshot" :: held 2.772s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Created reservations ['deca29d6-8428-4e9f-8d7f-9a5dc570e3f6', 'cda3f007-72a7-431d-b2cd-67a89f4921df', '6bd95743-13bd-41d8-a9f0-0c3e182aad00', '6fde236a-249d-41e7-9431-dd0eb7e3e1a7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:14:15 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2 1073741824" returned: 0 in 0.781s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Delete snapshot completed successfully.
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-735ecfd7-b9d1-4cfb-ab04-2a12e940e51b tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-ede46442-3d7a-4004-8a5f-3e01140e4f0b-delete_snapshot" released by "delete_snapshot" :: held 3.071s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:15 devstack sudo[101822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2
Sep 25 15:14:15 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "cinder-e5121ee7-c82c-49f7-a7f9-86cbdd203d91-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-e5121ee7-c82c-49f7-a7f9-86cbdd203d91-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:16 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2" returned: 0 in 0.415s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:14:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "cinder-quobyte-e5121ee7-c82c-49f7-a7f9-86cbdd203d91" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e1fe60-d6ae-4b9e-ba23-069059960203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd8b11f5-a305-4090-8e5b-fa790b80fe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-quobyte-e5121ee7-c82c-49f7-a7f9-86cbdd203d91" acquired by "delete_volume" :: waited 0.042s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Volume volume-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2 (4eb47804-7aaa-4f9c-8914-b3a760cc2bd2): created successfully
Sep 25 15:14:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd8b11f5-a305-4090-8e5b-fa790b80fe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Flow 'volume_create_manager' (c4313f07-ad43-4791-ba62-6c62f620ad1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:14:16 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[235fc2cf-085e-43a7-b304-6a438edf9f80]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:14:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4339bc85-346d-4244-9903-57de921d5c65 tempest-VolumesTransfersV355Test-1363721610 None] Created volume successfully.
Sep 25 15:14:16 devstack sudo[101825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91
Sep 25 15:14:16 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:17 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91" returned: 0 in 0.616s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:17 devstack sudo[101831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91
Sep 25 15:14:17 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:17 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5121ee7-c82c-49f7-a7f9-86cbdd203d91" returned: 0 in 0.449s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-quobyte-e5121ee7-c82c-49f7-a7f9-86cbdd203d91" released by "delete_volume" :: held 1.170s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:17 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Created reservations ['e46d30ab-41e8-483f-9669-82175ac8c64e', 'f8904d36-b059-4283-be3b-e847a97af74e', 'eec1d42e-eda5-4246-9d56-60addfaf955a', '1f5f4087-e943-4730-ba2f-f97b3bf984ee'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:14:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:14:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:14:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:17 devstack sudo[101838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:14:17 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:18 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.450s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:18 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:14:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fd46a489-6b19-45d5-a1ad-5cc43746e6de tempest-VolumesTransfersV355Test-639107804 None] Transfer volume completed successfully.
Sep 25 15:14:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Deleted volume successfully.
Sep 25 15:14:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf519856-01ac-4507-9f0a-4ae2c1f5a1ec tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-e5121ee7-c82c-49f7-a7f9-86cbdd203d91-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "cinder-1349b69d-8066-4926-930a-5475ad443ba2-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-1349b69d-8066-4926-930a-5475ad443ba2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "cinder-quobyte-1349b69d-8066-4926-930a-5475ad443ba2" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-quobyte-1349b69d-8066-4926-930a-5475ad443ba2" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:18 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf061742-9ec0-4b94-9084-988628c0c718]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:14:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1349b69d-8066-4926-930a-5475ad443ba2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:18 devstack sudo[101851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1349b69d-8066-4926-930a-5475ad443ba2
Sep 25 15:14:18 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:19 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Acquiring lock "cinder-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1349b69d-8066-4926-930a-5475ad443ba2" returned: 0 in 0.521s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1349b69d-8066-4926-930a-5475ad443ba2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Lock "cinder-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:19 devstack sudo[101858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1349b69d-8066-4926-930a-5475ad443ba2
Sep 25 15:14:19 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Acquiring lock "cinder-quobyte-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Lock "cinder-quobyte-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c5e075-d55d-456d-b402-23da86a39e53]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:19 devstack sudo[101863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2
Sep 25 15:14:19 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:19 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1349b69d-8066-4926-930a-5475ad443ba2" returned: 0 in 0.351s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-quobyte-1349b69d-8066-4926-930a-5475ad443ba2" released by "delete_volume" :: held 0.979s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:19 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-fa1ece83-f460-4deb-b1cb-f42bbf3de1ca req-621653a0-0f46-4893-b267-c5bebcd8f5a3 tempest-TestStampPattern-365617491 None] Terminate volume connection completed successfully.
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-fa1ece83-f460-4deb-b1cb-f42bbf3de1ca req-621653a0-0f46-4893-b267-c5bebcd8f5a3 tempest-TestStampPattern-365617491 None] Deleting attachment eb0a54b1-063f-4668-be22-4e074e86c362. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Created reservations ['e262b1d3-4ef4-4edc-921e-eec4f9b9f5b9', '188c5a6b-c719-45dc-972b-f95c6108bbe6', '71028769-aee1-420f-8900-6b9edf9dda77', '9679e0df-329a-47bc-9002-b82ca24ff444'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:19 devstack sudo[101896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:14:19 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:19 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2" returned: 0 in 0.582s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:20 devstack sudo[101898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2
Sep 25 15:14:20 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:20 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.353s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:14:20 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Deleted volume successfully.
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cf5cf74b-1627-49a3-a2b9-c632922048fa tempest-SnapshotDependencyTests-1013833494 None] Lock "cinder-1349b69d-8066-4926-930a-5475ad443ba2-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:20 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2" returned: 0 in 0.504s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Lock "cinder-quobyte-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2" released by "delete_volume" :: held 1.144s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] Creating offline snapshot ab6adb3a-5624-40d6-9638-02b91172ec51 of volume 76ab0c1a-7c96-4767-aed4-b1bb4016c888 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Created reservations ['afd2cebc-0b4d-45c5-92e9-79cc29b1558a', '35bc18cf-400b-4246-bd3f-2078dcee0ecd', 'd49855a5-9c2c-42af-a046-88f2a0688a7e', '106502b9-8f4c-469d-a5b0-ab0f721b4224'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[780d178e-7afd-4573-8c0c-5f996c06f002]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:20 devstack sudo[101903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888
Sep 25 15:14:20 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:20 devstack sudo[101906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:14:20 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:20 devstack sudo[101911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:14:20 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:21 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888" returned: 0 in 0.625s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:21 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.490s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:14:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Deleted volume successfully.
Sep 25 15:14:21 devstack sudo[101921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51 1G
Sep 25 15:14:21 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-63d6d754-62d6-4551-9b64-7865a527d174 tempest-VolumesTransfersV355Test-1122726611 None] Lock "cinder-4eb47804-7aaa-4f9c-8914-b3a760cc2bd2-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:21 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.546s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:14:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:14:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 29 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:14:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>, <Thread(Rabbit-heartbeat, started daemon 129983531771584)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:14:22 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51 1G" returned: 0 in 0.897s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:22 devstack sudo[101928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51
Sep 25 15:14:22 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:22 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:14:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Flow 'volume_create_manager' (6dd29013-4410-4104-bf05-bf4f9cd081b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:14:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfba899e-fa45-47d4-8e93-c2c89d259096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfba899e-fa45-47d4-8e93-c2c89d259096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1523751707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f525276f-c1d8-4eaa-8d9a-65f72ba96fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09981669d1143eaa83e1a4eac97500e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:14:23Z,use_quota=True,user_id='3cb86f487a0c422593931c3f1dbe3cc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0dfe0b8-a0e8-4c29-9836-802e0063e1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0dfe0b8-a0e8-4c29-9836-802e0063e1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:22 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc9f364-000d-49f7-a14c-bb6937f630a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc9f364-000d-49f7-a14c-bb6937f630a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f525276f-c1d8-4eaa-8d9a-65f72ba96fce', 'volume_name': 'volume-f525276f-c1d8-4eaa-8d9a-65f72ba96fce', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7797b031-f0a0-4ac2-83b3-c81352a4683f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7797b031-f0a0-4ac2-83b3-c81352a4683f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9a5fa0-3880-44d4-9d75-89be8c267e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:22 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Volume f525276f-c1d8-4eaa-8d9a-65f72ba96fce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f525276f-c1d8-4eaa-8d9a-65f72ba96fce', 'volume_size': 1}
Sep 25 15:14:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51" returned: 0 in 0.641s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:22 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51 is being set with open permissions: ugo+rw
Sep 25 15:14:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:22 devstack sudo[101933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51
Sep 25 15:14:22 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:23 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51" returned: 0 in 0.307s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:23 devstack sudo[101936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.info
Sep 25 15:14:23 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:23 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.info" returned: 0 in 0.418s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:23 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.info is being set with open permissions: ugo+rw
Sep 25 15:14:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:23 devstack sudo[101939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.info
Sep 25 15:14:23 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:23 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.info" returned: 0 in 0.349s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.395s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.176s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1523751707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f525276f-c1d8-4eaa-8d9a-65f72ba96fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09981669d1143eaa83e1a4eac97500e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:14:23Z,use_quota=True,user_id='3cb86f487a0c422593931c3f1dbe3cc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:14:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Creating volume f525276f-c1d8-4eaa-8d9a-65f72ba96fce {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:14:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:14:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:14:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:14:23 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:14:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f525276f-c1d8-4eaa-8d9a-65f72ba96fce 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:24 devstack sudo[101943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f525276f-c1d8-4eaa-8d9a-65f72ba96fce 1073741824
Sep 25 15:14:24 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2e30eabe-8e62-4580-a4be-21a54d123f90 tempest-TestStampPattern-365617491 None] Create snapshot completed successfully
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Flow 'volume_create_manager' (6642ba72-ca66-4467-8f5b-817892db95ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad0aa12-abdc-410f-b3d3-f82fdc23aebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad0aa12-abdc-410f-b3d3-f82fdc23aebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-651749583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7725385-5ee2-42b6-8e67-e5d63355f7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b174ae548546b0ae18ca72976a198b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:14:24Z,use_quota=True,user_id='2212875320984ac2b2a44e6dfbf459f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bd10bb-5cf8-4c75-bc61-bd18e45307b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bd10bb-5cf8-4c75-bc61-bd18e45307b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37b9312-a8ba-4769-ae71-f7ff83f0a5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37b9312-a8ba-4769-ae71-f7ff83f0a5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7725385-5ee2-42b6-8e67-e5d63355f7b5', 'volume_name': 'volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (994fd217-901d-4fde-a4f4-3c7177f639d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (994fd217-901d-4fde-a4f4-3c7177f639d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4e48f7-20ef-42fe-8321-4666224e8003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:24 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Volume c7725385-5ee2-42b6-8e67-e5d63355f7b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5', 'volume_size': 1}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:24 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f525276f-c1d8-4eaa-8d9a-65f72ba96fce 1073741824" returned: 0 in 0.649s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f525276f-c1d8-4eaa-8d9a-65f72ba96fce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:24 devstack sudo[101949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f525276f-c1d8-4eaa-8d9a-65f72ba96fce
Sep 25 15:14:24 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:24 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f525276f-c1d8-4eaa-8d9a-65f72ba96fce" returned: 0 in 0.302s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.380s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-651749583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7725385-5ee2-42b6-8e67-e5d63355f7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b174ae548546b0ae18ca72976a198b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:14:24Z,use_quota=True,user_id='2212875320984ac2b2a44e6dfbf459f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Creating volume c7725385-5ee2-42b6-8e67-e5d63355f7b5 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:14:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:14:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:14:25 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:14:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9a5fa0-3880-44d4-9d75-89be8c267e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f525276f-c1d8-4eaa-8d9a-65f72ba96fce', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c04f2cf-7d49-46b8-a277-e5e5712766ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:25 devstack sudo[101952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 1073741824
Sep 25 15:14:25 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:25 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Volume volume-f525276f-c1d8-4eaa-8d9a-65f72ba96fce (f525276f-c1d8-4eaa-8d9a-65f72ba96fce): created successfully
Sep 25 15:14:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c04f2cf-7d49-46b8-a277-e5e5712766ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Flow 'volume_create_manager' (6dd29013-4410-4104-bf05-bf4f9cd081b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:14:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-296bff59-e6ae-4e50-b1d6-5f32935f751f tempest-VolumesTransfersV355Test-1363721610 None] Created volume successfully.
Sep 25 15:14:25 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 1073741824" returned: 0 in 0.609s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:25 devstack sudo[101957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5
Sep 25 15:14:25 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:25 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5" returned: 0 in 0.302s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:14:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4e48f7-20ef-42fe-8321-4666224e8003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faeb637b-cd5e-4dce-b705-26b7815079c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:26 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Volume volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 (c7725385-5ee2-42b6-8e67-e5d63355f7b5): created successfully
Sep 25 15:14:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faeb637b-cd5e-4dce-b705-26b7815079c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Flow 'volume_create_manager' (6642ba72-ca66-4467-8f5b-817892db95ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:14:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-93e36ce3-f772-4448-8caa-490400bc7a17 tempest-VolumesActionsTest-1020599487 None] Created volume successfully.
Sep 25 15:14:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Acquiring lock "cinder-f525276f-c1d8-4eaa-8d9a-65f72ba96fce-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Lock "cinder-f525276f-c1d8-4eaa-8d9a-65f72ba96fce-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Acquiring lock "cinder-quobyte-f525276f-c1d8-4eaa-8d9a-65f72ba96fce" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Lock "cinder-quobyte-f525276f-c1d8-4eaa-8d9a-65f72ba96fce" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9564a66f-509d-4809-af3a-32d7b5a3b722]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:14:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f525276f-c1d8-4eaa-8d9a-65f72ba96fce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:26 devstack sudo[101960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f525276f-c1d8-4eaa-8d9a-65f72ba96fce
Sep 25 15:14:26 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:26 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f525276f-c1d8-4eaa-8d9a-65f72ba96fce" returned: 0 in 0.638s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f525276f-c1d8-4eaa-8d9a-65f72ba96fce {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:27 devstack sudo[101967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f525276f-c1d8-4eaa-8d9a-65f72ba96fce
Sep 25 15:14:27 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:27 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f525276f-c1d8-4eaa-8d9a-65f72ba96fce" returned: 0 in 0.435s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Lock "cinder-quobyte-f525276f-c1d8-4eaa-8d9a-65f72ba96fce" released by "delete_volume" :: held 1.146s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:27 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Created reservations ['a891e7ed-32cb-4c3a-9d94-f2a17836f2f8', '0cbf21f9-c17e-4e59-a2b9-b1d9c8a69fcd', '45941af3-13be-471a-8232-b5fa7a8ba0d7', '37901d9f-34d8-495e-8cbe-ba77bcdeb25b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:14:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:14:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:14:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:27 devstack sudo[101988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:14:27 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:28 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.394s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:28 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:14:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Deleted volume successfully.
Sep 25 15:14:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c76a9ff1-80ea-4cf7-95c0-05a6acb64361 tempest-VolumesTransfersV355Test-1122726611 None] Lock "cinder-f525276f-c1d8-4eaa-8d9a-65f72ba96fce-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Flow 'volume_create_manager' (701a43b0-3a0e-4b8b-8bed-73b2a747cae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f9b531-416b-4917-b3bd-db931517cc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f9b531-416b-4917-b3bd-db931517cc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-765975322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54066646-3bb5-4f6c-af9a-b0bb52296bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4410e07d91a74bc394ac3cbb2e0dee80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ab6adb3a-5624-40d6-9638-02b91172ec51,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:14:36Z,use_quota=True,user_id='38951778d8284e68ad3f655aedb9ddd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740a99d9-4a54-4083-9df7-cf8648b430d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740a99d9-4a54-4083-9df7-cf8648b430d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710bd1c0-7285-4a27-8ab7-cb9033ec7bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710bd1c0-7285-4a27-8ab7-cb9033ec7bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '54066646-3bb5-4f6c-af9a-b0bb52296bfe', 'volume_name': 'volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe', 'volume_size': 1, 'snapshot_id': 'ab6adb3a-5624-40d6-9638-02b91172ec51'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9794835f-ff59-4f8f-a3af-17c39c8911ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9794835f-ff59-4f8f-a3af-17c39c8911ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2218cdbe-7260-46f3-aa54-6ae36e37cf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:35 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Volume 54066646-3bb5-4f6c-af9a-b0bb52296bfe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe', 'volume_size': 1, 'snapshot_id': 'ab6adb3a-5624-40d6-9638-02b91172ec51'}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Acquiring lock "cinder-quobyte-ab6adb3a-5624-40d6-9638-02b91172ec51-54066646-3bb5-4f6c-af9a-b0bb52296bfe" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Lock "cinder-quobyte-ab6adb3a-5624-40d6-9638-02b91172ec51-54066646-3bb5-4f6c-af9a-b0bb52296bfe" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Creating volume 54066646-3bb5-4f6c-af9a-b0bb52296bfe from snapshot ab6adb3a-5624-40d6-9638-02b91172ec51 {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:14:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Acquiring lock "cinder-quobyte-54066646-3bb5-4f6c-af9a-b0bb52296bfe" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Lock "cinder-quobyte-54066646-3bb5-4f6c-af9a-b0bb52296bfe" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] snapshot: ab6adb3a-5624-40d6-9638-02b91172ec51, volume: 54066646-3bb5-4f6c-af9a-b0bb52296bfe,  {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 15:14:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:14:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:14:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:36 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc604513-e920-497d-9d44-136277af525d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:14:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:36 devstack sudo[102028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51
Sep 25 15:14:36 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:36 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51" returned: 0 in 0.511s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:14:36 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be2d3f8-b503-4809-bc8d-41213d0ec507]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:14:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:36 devstack sudo[102033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888
Sep 25 15:14:36 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:37 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888" returned: 0 in 0.626s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 15:14:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 15:14:37 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Path /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 15:14:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:37 devstack sudo[102039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe
Sep 25 15:14:37 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:45 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=85,cinder:UPDATE=90,cinder:INSERT=30,cinder:DELETE=13 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:14:46 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=94,cinder:SELECT=81,cinder:INSERT=25,cinder:DELETE=4 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:14:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f188626e-3509-45a1-b836-a45f14dff789 tempest-VolumesActionsTest-1020599487 None] Acquiring lock "cinder-c7725385-5ee2-42b6-8e67-e5d63355f7b5" by "attach_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f188626e-3509-45a1-b836-a45f14dff789 tempest-VolumesActionsTest-1020599487 None] Lock "cinder-c7725385-5ee2-42b6-8e67-e5d63355f7b5" acquired by "attach_volume" :: waited 0.058s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f188626e-3509-45a1-b836-a45f14dff789 tempest-VolumesActionsTest-1020599487 None] Attaching volume c7725385-5ee2-42b6-8e67-e5d63355f7b5 to instance 7b236b73-f6e8-4f8a-8e8f-8489a0d33494 at mountpoint /dev/vdb on host None.
Sep 25 15:14:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f188626e-3509-45a1-b836-a45f14dff789 tempest-VolumesActionsTest-1020599487 None] Attach volume completed successfully.
Sep 25 15:14:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f188626e-3509-45a1-b836-a45f14dff789 tempest-VolumesActionsTest-1020599487 None] Lock "cinder-c7725385-5ee2-42b6-8e67-e5d63355f7b5" released by "attach_volume" :: held 0.439s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5a254bb8-7ce0-421e-a78b-768a7b4942ae tempest-VolumesActionsTest-1020599487 None] Acquiring lock "cinder-c7725385-5ee2-42b6-8e67-e5d63355f7b5-detach_volume" by "detach_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:14:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5a254bb8-7ce0-421e-a78b-768a7b4942ae tempest-VolumesActionsTest-1020599487 None] Lock "cinder-c7725385-5ee2-42b6-8e67-e5d63355f7b5-detach_volume" acquired by "detach_volume" :: waited 0.108s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:14:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5a254bb8-7ce0-421e-a78b-768a7b4942ae tempest-VolumesActionsTest-1020599487 None] Detaching volume c7725385-5ee2-42b6-8e67-e5d63355f7b5 from instance 7b236b73-f6e8-4f8a-8e8f-8489a0d33494.
Sep 25 15:14:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5a254bb8-7ce0-421e-a78b-768a7b4942ae tempest-VolumesActionsTest-1020599487 None] Detach volume completed successfully.
Sep 25 15:14:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5a254bb8-7ce0-421e-a78b-768a7b4942ae tempest-VolumesActionsTest-1020599487 None] Lock "cinder-c7725385-5ee2-42b6-8e67-e5d63355f7b5-detach_volume" released by "detach_volume" :: held 0.365s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:53 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe" returned: 0 in 16.096s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Image conversion details: src /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888, size 1024.00 MB, duration 16.10 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:14:53 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Converted 1024.00 MB image at 63.61 MB/s
Sep 25 15:14:53 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe is being set with open permissions: ugo+rw
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:53 devstack sudo[102177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe
Sep 25 15:14:53 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Flow 'volume_create_manager' (7ee4f3a8-f127-4d7f-a38e-0d46ba9181f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432ce5c2-8b9d-465a-bc55-55534d9e2941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432ce5c2-8b9d-465a-bc55-55534d9e2941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1919117939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d280d9a8-0437-4809-865e-e69cb0c80f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f74dc96df4496ca39c3c7312965f4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:14:53Z,use_quota=True,user_id='9981be2428c34455a03eac255cb053b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358c8d2d-c89a-4270-8a9d-c5d4d5513186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358c8d2d-c89a-4270-8a9d-c5d4d5513186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4da035-67a5-4bb6-bdc1-b8ad4779d24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4da035-67a5-4bb6-bdc1-b8ad4779d24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd280d9a8-0437-4809-865e-e69cb0c80f83', 'volume_name': 'volume-d280d9a8-0437-4809-865e-e69cb0c80f83', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec38046a-3386-4b13-9e4f-3dc292b66282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec38046a-3386-4b13-9e4f-3dc292b66282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d29e53-c38e-40c2-b25a-73486f95b193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:53 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Volume d280d9a8-0437-4809-865e-e69cb0c80f83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d280d9a8-0437-4809-865e-e69cb0c80f83', 'volume_size': 1}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:53 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe" returned: 0 in 0.400s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Lock "cinder-quobyte-54066646-3bb5-4f6c-af9a-b0bb52296bfe" released by "_copy_volume_from_snapshot" :: held 17.778s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Lock "cinder-quobyte-ab6adb3a-5624-40d6-9638-02b91172ec51-54066646-3bb5-4f6c-af9a-b0bb52296bfe" released by "_create_volume_from_snapshot" :: held 17.884s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.906s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.223s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1919117939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d280d9a8-0437-4809-865e-e69cb0c80f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f74dc96df4496ca39c3c7312965f4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:14:53Z,use_quota=True,user_id='9981be2428c34455a03eac255cb053b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Creating volume d280d9a8-0437-4809-865e-e69cb0c80f83 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:14:53 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:53 devstack sudo[102188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83 1073741824
Sep 25 15:14:53 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2218cdbe-7260-46f3-aa54-6ae36e37cf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe', 'volume_size': 1, 'snapshot_id': 'ab6adb3a-5624-40d6-9638-02b91172ec51'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d9ca52-c1d4-49b0-be51-93682b1e746a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:53 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Volume volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe (54066646-3bb5-4f6c-af9a-b0bb52296bfe): created successfully
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d9ca52-c1d4-49b0-be51-93682b1e746a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Flow 'volume_create_manager' (701a43b0-3a0e-4b8b-8bed-73b2a747cae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:14:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-43a4c743-4e58-4619-81c7-505d59420ecb tempest-TestStampPattern-365617491 None] Created volume successfully.
Sep 25 15:14:54 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83 1073741824" returned: 0 in 0.881s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:54 devstack sudo[102205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83
Sep 25 15:14:54 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:55 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83" returned: 0 in 0.381s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:14:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:14:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d29e53-c38e-40c2-b25a-73486f95b193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d280d9a8-0437-4809-865e-e69cb0c80f83', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced35ee6-5f49-4b13-96c6-bf0140d3e8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:55 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Volume volume-d280d9a8-0437-4809-865e-e69cb0c80f83 (d280d9a8-0437-4809-865e-e69cb0c80f83): created successfully
Sep 25 15:14:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced35ee6-5f49-4b13-96c6-bf0140d3e8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Flow 'volume_create_manager' (7ee4f3a8-f127-4d7f-a38e-0d46ba9181f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:14:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-264fe118-5d70-4306-8018-d5cc900425ae tempest-VolumesCloneTest-1704941256 None] Created volume successfully.
Sep 25 15:14:56 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:14:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Flow 'volume_create_manager' (070eaacd-333c-4c56-a9ea-b43c2706a2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:14:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99bec6b6-aab3-41c8-bc5f-0e723ca411df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99bec6b6-aab3-41c8-bc5f-0e723ca411df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1678503800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=856993c4-9a04-4201-83b4-938951d101b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f74dc96df4496ca39c3c7312965f4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:14:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=d280d9a8-0437-4809-865e-e69cb0c80f83,status='creating',terminated_at=None,updated_at=2026-09-25T13:14:57Z,use_quota=True,user_id='9981be2428c34455a03eac255cb053b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c18afff-eb64-49db-8f39-56fcd5c4dd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c18afff-eb64-49db-8f39-56fcd5c4dd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f532fb-4027-4af8-af20-11ade518b1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f532fb-4027-4af8-af20-11ade518b1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '856993c4-9a04-4201-83b4-938951d101b1', 'volume_name': 'volume-856993c4-9a04-4201-83b4-938951d101b1', 'volume_size': 2, 'source_volid': 'd280d9a8-0437-4809-865e-e69cb0c80f83', 'source_volstatus': 'available'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae54740b-2f5a-446a-ba0c-14342682ff61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae54740b-2f5a-446a-ba0c-14342682ff61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:14:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d00820-6fae-4718-a46a-4f4a2459331c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:14:56 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Volume 856993c4-9a04-4201-83b4-938951d101b1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-856993c4-9a04-4201-83b4-938951d101b1', 'volume_size': 2, 'source_volid': 'd280d9a8-0437-4809-865e-e69cb0c80f83', 'source_volstatus': 'available'}
Sep 25 15:14:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:14:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:14:56 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Cloning volume d280d9a8-0437-4809-865e-e69cb0c80f83 to volume 856993c4-9a04-4201-83b4-938951d101b1
Sep 25 15:14:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Creating offline snapshot 6954064d-7fd5-4967-b0a8-14317ff3e1cc of volume d280d9a8-0437-4809-865e-e69cb0c80f83 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:14:57 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e94380-c078-4839-a015-4bf9b0252f7e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:14:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:57 devstack sudo[102248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83
Sep 25 15:14:57 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:57 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83" returned: 0 in 0.506s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:57 devstack sudo[102274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc 1G
Sep 25 15:14:57 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:58 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc 1G" returned: 0 in 0.636s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d280d9a8-0437-4809-865e-e69cb0c80f83 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:58 devstack sudo[102284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d280d9a8-0437-4809-865e-e69cb0c80f83 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc
Sep 25 15:14:58 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:58 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d280d9a8-0437-4809-865e-e69cb0c80f83 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc" returned: 0 in 0.387s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:58 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc is being set with open permissions: ugo+rw
Sep 25 15:14:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:58 devstack sudo[102290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc
Sep 25 15:14:58 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:59 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc" returned: 0 in 0.538s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:59 devstack sudo[102295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.info
Sep 25 15:14:59 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:14:59 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root
Sep 25 15:14:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.info" returned: 0 in 0.460s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:14:59 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.info is being set with open permissions: ugo+rw
Sep 25 15:14:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:14:59 devstack sudo[102298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.info
Sep 25 15:14:59 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:00 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.info" returned: 0 in 0.488s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Acquiring lock "cinder-quobyte-856993c4-9a04-4201-83b4-938951d101b1" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:15:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Lock "cinder-quobyte-856993c4-9a04-4201-83b4-938951d101b1" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:15:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] snapshot: 6954064d-7fd5-4967-b0a8-14317ff3e1cc, volume: 856993c4-9a04-4201-83b4-938951d101b1,  {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 15:15:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:15:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:15:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:15:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:15:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:15:00 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[26605f43-2bb4-445a-a4fe-10a13871b501]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:15:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:00 devstack sudo[102305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc
Sep 25 15:15:00 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:01 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc" returned: 0 in 0.989s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d280d9a8-0437-4809-865e-e69cb0c80f83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:15:01 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ad5078-062b-48ae-b755-c7e9b136bb4e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:15:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:01 devstack sudo[102325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83
Sep 25 15:15:01 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:02 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83" returned: 0 in 0.793s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 15:15:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 15:15:02 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Path /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856993c4-9a04-4201-83b4-938951d101b1 not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 15:15:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856993c4-9a04-4201-83b4-938951d101b1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:02 devstack sudo[102333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856993c4-9a04-4201-83b4-938951d101b1
Sep 25 15:15:02 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:09 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=4 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:15:09 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:INSERT=3,cinder:SELECT=13,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:15:15 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856993c4-9a04-4201-83b4-938951d101b1" returned: 0 in 12.933s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:15 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Image conversion details: src /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83, size 1024.00 MB, duration 12.93 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856993c4-9a04-4201-83b4-938951d101b1 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:15:15 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Converted 1024.00 MB image at 79.17 MB/s
Sep 25 15:15:15 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856993c4-9a04-4201-83b4-938951d101b1 is being set with open permissions: ugo+rw
Sep 25 15:15:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856993c4-9a04-4201-83b4-938951d101b1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:15 devstack sudo[102484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856993c4-9a04-4201-83b4-938951d101b1
Sep 25 15:15:15 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b4150ec-2678-428d-b7ef-e509a3810d4d tempest-VolumesActionsTest-1020599487 None] Acquiring lock "cinder-c7725385-5ee2-42b6-8e67-e5d63355f7b5" by "attach_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:15:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b4150ec-2678-428d-b7ef-e509a3810d4d tempest-VolumesActionsTest-1020599487 None] Lock "cinder-c7725385-5ee2-42b6-8e67-e5d63355f7b5" acquired by "attach_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:15:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6b4150ec-2678-428d-b7ef-e509a3810d4d tempest-VolumesActionsTest-1020599487 None] Attaching volume c7725385-5ee2-42b6-8e67-e5d63355f7b5 to instance 64cea252-faf0-4362-a1d4-5f9d5e4a4bb1 at mountpoint /dev/vdb on host None.
Sep 25 15:15:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6b4150ec-2678-428d-b7ef-e509a3810d4d tempest-VolumesActionsTest-1020599487 None] Attach volume completed successfully.
Sep 25 15:15:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6b4150ec-2678-428d-b7ef-e509a3810d4d tempest-VolumesActionsTest-1020599487 None] Lock "cinder-c7725385-5ee2-42b6-8e67-e5d63355f7b5" released by "attach_volume" :: held 0.132s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:15:15 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856993c4-9a04-4201-83b4-938951d101b1" returned: 0 in 0.435s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Lock "cinder-quobyte-856993c4-9a04-4201-83b4-938951d101b1" released by "_copy_volume_from_snapshot" :: held 15.389s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:15:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Acquiring lock "cinder-quobyte-6954064d-7fd5-4967-b0a8-14317ff3e1cc" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:15:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Lock "cinder-quobyte-6954064d-7fd5-4967-b0a8-14317ff3e1cc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:15:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Deleting offline snapshot 6954064d-7fd5-4967-b0a8-14317ff3e1cc of volume d280d9a8-0437-4809-865e-e69cb0c80f83 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:15:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] snapshot_file for this snap is: volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:15:15 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b9019a-c51b-4da9-938d-cdd559119b0f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:15:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:15 devstack sudo[102487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc
Sep 25 15:15:15 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-691c551f-4433-4691-aea7-de23cb66ab56 tempest-VolumesActionsTest-1020599487 None] Acquiring lock "cinder-c7725385-5ee2-42b6-8e67-e5d63355f7b5-detach_volume" by "detach_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:15:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-691c551f-4433-4691-aea7-de23cb66ab56 tempest-VolumesActionsTest-1020599487 None] Lock "cinder-c7725385-5ee2-42b6-8e67-e5d63355f7b5-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:15:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-691c551f-4433-4691-aea7-de23cb66ab56 tempest-VolumesActionsTest-1020599487 None] Detaching volume c7725385-5ee2-42b6-8e67-e5d63355f7b5 from instance 64cea252-faf0-4362-a1d4-5f9d5e4a4bb1.
Sep 25 15:15:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-691c551f-4433-4691-aea7-de23cb66ab56 tempest-VolumesActionsTest-1020599487 None] Detach volume completed successfully.
Sep 25 15:15:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-691c551f-4433-4691-aea7-de23cb66ab56 tempest-VolumesActionsTest-1020599487 None] Lock "cinder-c7725385-5ee2-42b6-8e67-e5d63355f7b5-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:15:16 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc" returned: 0 in 0.519s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d280d9a8-0437-4809-865e-e69cb0c80f83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:15:16 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf56bb38-a7be-4b9c-923d-11489a15d01a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:15:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:16 devstack sudo[102492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83
Sep 25 15:15:16 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:17 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83" returned: 0 in 0.754s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:17 devstack sudo[102512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc
Sep 25 15:15:17 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:17 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc" returned: 0 in 0.503s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:17 devstack sudo[102528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc
Sep 25 15:15:17 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:17 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83.6954064d-7fd5-4967-b0a8-14317ff3e1cc" returned: 0 in 0.330s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Lock "cinder-quobyte-6954064d-7fd5-4967-b0a8-14317ff3e1cc" released by "_delete_snapshot" :: held 2.269s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:15:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.056s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:15:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d00820-6fae-4718-a46a-4f4a2459331c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-856993c4-9a04-4201-83b4-938951d101b1', 'volume_size': 2, 'source_volid': 'd280d9a8-0437-4809-865e-e69cb0c80f83', 'source_volstatus': 'available'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:15:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5626b590-5b23-4f74-8754-1234aabbe701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:15:18 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Volume volume-856993c4-9a04-4201-83b4-938951d101b1 (856993c4-9a04-4201-83b4-938951d101b1): created successfully
Sep 25 15:15:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5626b590-5b23-4f74-8754-1234aabbe701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:15:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Flow 'volume_create_manager' (070eaacd-333c-4c56-a9ea-b43c2706a2c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:15:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f5c95a42-0aaa-432d-b25c-a10f3361bc90 tempest-VolumesCloneTest-1704941256 None] Created volume successfully.
Sep 25 15:15:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Acquiring lock "cinder-856993c4-9a04-4201-83b4-938951d101b1-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:15:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Lock "cinder-856993c4-9a04-4201-83b4-938951d101b1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:15:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Acquiring lock "cinder-quobyte-856993c4-9a04-4201-83b4-938951d101b1" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:15:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Lock "cinder-quobyte-856993c4-9a04-4201-83b4-938951d101b1" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:15:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[17911e33-c96a-43f6-a2d9-dc6ee601e91d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:15:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856993c4-9a04-4201-83b4-938951d101b1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:19 devstack sudo[102534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856993c4-9a04-4201-83b4-938951d101b1
Sep 25 15:15:19 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:19 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856993c4-9a04-4201-83b4-938951d101b1" returned: 0 in 0.507s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856993c4-9a04-4201-83b4-938951d101b1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:19 devstack sudo[102539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856993c4-9a04-4201-83b4-938951d101b1
Sep 25 15:15:19 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:20 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-856993c4-9a04-4201-83b4-938951d101b1" returned: 0 in 0.307s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Lock "cinder-quobyte-856993c4-9a04-4201-83b4-938951d101b1" released by "delete_volume" :: held 0.885s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Created reservations ['105edb72-4e41-4636-b396-6bb1155764c8', 'd0154f63-65d7-4924-8505-06feb45239dd', '3ec6a9b0-b799-4677-bbb3-d11687e43c89', '80d2e8f2-6221-4b3b-bd3c-2d16b136329a'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:20 devstack sudo[102542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:15:20 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Acquiring lock "cinder-d280d9a8-0437-4809-865e-e69cb0c80f83-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Lock "cinder-d280d9a8-0437-4809-865e-e69cb0c80f83-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Acquiring lock "cinder-quobyte-d280d9a8-0437-4809-865e-e69cb0c80f83" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Lock "cinder-quobyte-d280d9a8-0437-4809-865e-e69cb0c80f83" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[296e6499-548d-4a90-90ac-4599e8144e85]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:20 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.398s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:15:20 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Deleted volume successfully.
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3c17ffb1-9ad4-4aaf-8ba8-f14bff5868db tempest-VolumesCloneTest-1704941256 None] Lock "cinder-856993c4-9a04-4201-83b4-938951d101b1-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:15:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:20 devstack sudo[102544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83
Sep 25 15:15:20 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:20 devstack sudo[102546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:15:20 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:21 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.332s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 29 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>, <Thread(Rabbit-heartbeat, started daemon 129983531771584)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:15:21 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83" returned: 0 in 0.556s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:21 devstack sudo[102553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83
Sep 25 15:15:21 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-897bcfbe-312c-4177-becb-2e97c2fc89d8 tempest-VolumesActionsTest-1020599487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-897bcfbe-312c-4177-becb-2e97c2fc89d8 tempest-VolumesActionsTest-1020599487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[072ac9a9-acf1-403f-9136-63364c0eff93]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897bcfbe-312c-4177-becb-2e97c2fc89d8 tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:21 devstack sudo[102555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5
Sep 25 15:15:21 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:21 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d280d9a8-0437-4809-865e-e69cb0c80f83" returned: 0 in 0.326s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Lock "cinder-quobyte-d280d9a8-0437-4809-865e-e69cb0c80f83" released by "delete_volume" :: held 0.975s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Created reservations ['ed9939aa-19f8-41d8-b3b6-015ff71e9972', '2166fe5e-0065-4c54-9f42-b3616f017156', '8d0c5acc-c728-403e-8a14-dff593658f7e', 'f3155d79-eff6-4944-abfc-3ef0862ddc59'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:21 devstack sudo[102558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:15:21 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:21 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897bcfbe-312c-4177-becb-2e97c2fc89d8 tempest-VolumesActionsTest-1020599487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5" returned: 0 in 0.510s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bc6f75-729f-4e90-b926-b90f7aa99c85]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:15:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897bcfbe-312c-4177-becb-2e97c2fc89d8 tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:22 devstack sudo[102563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5
Sep 25 15:15:22 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:22 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.288s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:22 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:15:22 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Deleted volume successfully.
Sep 25 15:15:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a80c379d-8aaf-4b42-a1db-7cb553f42361 tempest-VolumesCloneTest-1704941256 None] Lock "cinder-d280d9a8-0437-4809-865e-e69cb0c80f83-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:15:22 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897bcfbe-312c-4177-becb-2e97c2fc89d8 tempest-VolumesActionsTest-1020599487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5" returned: 0 in 0.432s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897bcfbe-312c-4177-becb-2e97c2fc89d8 tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.b651326e-6705-4e51-a541-78a633d79c218hdfo4g9.img {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:22 devstack sudo[102569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.b651326e-6705-4e51-a541-78a633d79c218hdfo4g9.img
Sep 25 15:15:22 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:31 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=16,cinder:UPDATE=24,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=22,cinder:INSERT=7,cinder:SELECT=21,cinder:DELETE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-fc15c75d-7d29-4d84-b5f8-37aa19ce1d54 req-17e483b2-3e6a-477e-949d-ffe5a28299dc tempest-TestStampPattern-365617491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:15:32 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897bcfbe-312c-4177-becb-2e97c2fc89d8 tempest-VolumesActionsTest-1020599487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.b651326e-6705-4e51-a541-78a633d79c218hdfo4g9.img" returned: 0 in 10.183s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Flow 'volume_create_manager' (2b65a9de-a0ff-4f8f-bd0a-8f16443a5592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc79fedb-1be1-42ef-87f7-109053335b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edef6cd-8f66-49c6-a7a6-e494265a02e7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897bcfbe-312c-4177-becb-2e97c2fc89d8 tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc79fedb-1be1-42ef-87f7-109053335b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1499316462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='891d797ffd2547ab88d2b9435498bfba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:15:33Z,use_quota=True,user_id='264a9a2b4f9c4559ae5b29cd041969eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f318478a-7fb3-4331-b128-5e070c979d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f318478a-7fb3-4331-b128-5e070c979d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6519ae7-7555-4474-8720-0bb921b209df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6519ae7-7555-4474-8720-0bb921b209df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac', 'volume_name': 'volume-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f085b7af-e226-4d23-a53e-dc5d3f32ed6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f085b7af-e226-4d23-a53e-dc5d3f32ed6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c60398c5-7b46-49dc-b0a4-9447147ec83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:15:32 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Volume 54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac', 'volume_size': 1}
Sep 25 15:15:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:15:32 devstack sudo[102618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5
Sep 25 15:15:32 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:33 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-897bcfbe-312c-4177-becb-2e97c2fc89d8 tempest-VolumesActionsTest-1020599487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5" returned: 0 in 0.677s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:33 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-897bcfbe-312c-4177-becb-2e97c2fc89d8 tempest-VolumesActionsTest-1020599487 None] Image conversion details: src /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5, size 1024.00 MB, duration 10.18 sec, destination /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.b651326e-6705-4e51-a541-78a633d79c218hdfo4g9.img {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:15:33 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-897bcfbe-312c-4177-becb-2e97c2fc89d8 tempest-VolumesActionsTest-1020599487 None] Converted 1024.00 MB image at 100.55 MB/s
Sep 25 15:15:33 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-897bcfbe-312c-4177-becb-2e97c2fc89d8 tempest-VolumesActionsTest-1020599487 None] b651326e-6705-4e51-a541-78a633d79c21 was raw, no need to convert to raw {{(pid=87071) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 25 15:15:42 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:15:43 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=4 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:15:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-897bcfbe-312c-4177-becb-2e97c2fc89d8 tempest-VolumesActionsTest-1020599487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.545s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:15:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-897bcfbe-312c-4177-becb-2e97c2fc89d8 tempest-VolumesActionsTest-1020599487 None] Uploaded volume to glance image-id: b651326e-6705-4e51-a541-78a633d79c21. {{(pid=87071) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 25 15:15:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-fc15c75d-7d29-4d84-b5f8-37aa19ce1d54 req-17e483b2-3e6a-477e-949d-ffe5a28299dc tempest-TestStampPattern-365617491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 21.398s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:15:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-fc15c75d-7d29-4d84-b5f8-37aa19ce1d54 req-17e483b2-3e6a-477e-949d-ffe5a28299dc tempest-TestStampPattern-365617491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:15:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.255s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:15:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1499316462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='891d797ffd2547ab88d2b9435498bfba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:15:33Z,use_quota=True,user_id='264a9a2b4f9c4559ae5b29cd041969eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:15:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Creating volume 54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:15:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:15:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:15:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:15:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:15:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:15:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:15:53 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:15:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-897bcfbe-312c-4177-becb-2e97c2fc89d8 tempest-VolumesActionsTest-1020599487 None] Copy volume to image completed successfully.
Sep 25 15:15:54 devstack sudo[102630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac 1073741824
Sep 25 15:15:54 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:54 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-fc15c75d-7d29-4d84-b5f8-37aa19ce1d54 req-17e483b2-3e6a-477e-949d-ffe5a28299dc tempest-TestStampPattern-365617491 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd69c1b27-2fbe-44de-935a-a2d833f75b0e', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:15:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-fc15c75d-7d29-4d84-b5f8-37aa19ce1d54 req-17e483b2-3e6a-477e-949d-ffe5a28299dc tempest-TestStampPattern-365617491 None] attachment_update completed successfully.
Sep 25 15:15:54 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac 1073741824" returned: 0 in 0.697s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:54 devstack sudo[103049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac
Sep 25 15:15:54 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:55 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac" returned: 0 in 0.388s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:15:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:15:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c60398c5-7b46-49dc-b0a4-9447147ec83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:15:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fdd4748-9036-4731-93b7-4a7ccd27e23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:15:55 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Volume volume-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac (54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac): created successfully
Sep 25 15:15:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fdd4748-9036-4731-93b7-4a7ccd27e23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:15:55 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Flow 'volume_create_manager' (2b65a9de-a0ff-4f8f-bd0a-8f16443a5592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:15:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1ca4143b-bffc-4a76-bdf2-ed17fc67abbf tempest-VolumesNegativeTest-145747697 None] Created volume successfully.
Sep 25 15:15:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:15:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:15:55 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e7ea8f-a2c8-46bd-a9ea-d6e75db5a749]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:15:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:55 devstack sudo[103059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5
Sep 25 15:15:55 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:56 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5" returned: 0 in 0.475s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:56 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d24276d-333c-4d2a-8e83-602c32f83a55]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:15:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:56 devstack sudo[103068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5
Sep 25 15:15:56 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:56 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root
Sep 25 15:15:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5" returned: 0 in 0.567s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:15:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.1ded21ff-157c-46c5-aebb-3da67bf3dded9osu2v9v.img {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:15:56 devstack sudo[103081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.1ded21ff-157c-46c5-aebb-3da67bf3dded9osu2v9v.img
Sep 25 15:15:56 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:15:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-297c8a37-e066-4160-ad69-b437c0f3450d req-872c5791-2c84-4465-8da9-b1b9ca02d2fe tempest-TestStampPattern-365617491 None] Terminate volume connection completed successfully.
Sep 25 15:15:59 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-297c8a37-e066-4160-ad69-b437c0f3450d req-872c5791-2c84-4465-8da9-b1b9ca02d2fe tempest-TestStampPattern-365617491 None] Deleting attachment d69c1b27-2fbe-44de-935a-a2d833f75b0e. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:16:05 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:16:07 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.1ded21ff-157c-46c5-aebb-3da67bf3dded9osu2v9v.img" returned: 0 in 10.500s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:07 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[639e9633-2de1-4b7c-82bb-e55d175e8699]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:16:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:07 devstack sudo[103185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5
Sep 25 15:16:07 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:08 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5" returned: 0 in 0.857s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:08 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Image conversion details: src /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5, size 1024.00 MB, duration 10.50 sec, destination /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.1ded21ff-157c-46c5-aebb-3da67bf3dded9osu2v9v.img {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:16:08 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Converted 1024.00 MB image at 97.48 MB/s
Sep 25 15:16:08 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] 1ded21ff-157c-46c5-aebb-3da67bf3dded was raw, converting to qcow2 {{(pid=87071) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Sep 25 15:16:08 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e11b573-fcca-49f1-ac89-48aac3143f54]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:16:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.1ded21ff-157c-46c5-aebb-3da67bf3dded9osu2v9v.img {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:08 devstack sudo[103191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.1ded21ff-157c-46c5-aebb-3da67bf3dded9osu2v9v.img
Sep 25 15:16:08 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:08 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.1ded21ff-157c-46c5-aebb-3da67bf3dded9osu2v9v.img" returned: 0 in 0.483s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.1ded21ff-157c-46c5-aebb-3da67bf3dded9osu2v9v.img {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Acquiring lock "cinder-54066646-3bb5-4f6c-af9a-b0bb52296bfe-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:08 devstack sudo[103195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.1ded21ff-157c-46c5-aebb-3da67bf3dded9osu2v9v.img
Sep 25 15:16:08 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Lock "cinder-54066646-3bb5-4f6c-af9a-b0bb52296bfe-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Acquiring lock "cinder-quobyte-54066646-3bb5-4f6c-af9a-b0bb52296bfe" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Lock "cinder-quobyte-54066646-3bb5-4f6c-af9a-b0bb52296bfe" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:08 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2ad98a-4f72-4eac-bc8b-0746b1fefa49]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:16:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:09 devstack sudo[103211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe
Sep 25 15:16:09 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:09 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.1ded21ff-157c-46c5-aebb-3da67bf3dded9osu2v9v.img" returned: 1 in 0.708s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.1ded21ff-157c-46c5-aebb-3da67bf3dded9osu2v9v.img' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:16:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.1ded21ff-157c-46c5-aebb-3da67bf3dded9osu2v9v.img /opt/stack/data/cinder/conversion/vol_upload_iq4oi34i {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:09 devstack sudo[103237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.1ded21ff-157c-46c5-aebb-3da67bf3dded9osu2v9v.img /opt/stack/data/cinder/conversion/vol_upload_iq4oi34i
Sep 25 15:16:09 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:09 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe" returned: 0 in 0.677s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:09 devstack sudo[103244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe
Sep 25 15:16:09 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:09 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.1ded21ff-157c-46c5-aebb-3da67bf3dded9osu2v9v.img /opt/stack/data/cinder/conversion/vol_upload_iq4oi34i" returned: 0 in 0.481s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:09 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Image conversion details: src /opt/stack/data/cinder/conversion/c7725385-5ee2-42b6-8e67-e5d63355f7b5.temp_image.1ded21ff-157c-46c5-aebb-3da67bf3dded9osu2v9v.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_iq4oi34i {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:16:09 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 25 15:16:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[daff8ec8-cef5-4e2a-a49b-169bcf2bc644]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:16:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_iq4oi34i {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:09 devstack sudo[103250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_iq4oi34i
Sep 25 15:16:09 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:10 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54066646-3bb5-4f6c-af9a-b0bb52296bfe" returned: 0 in 0.455s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Lock "cinder-quobyte-54066646-3bb5-4f6c-af9a-b0bb52296bfe" released by "delete_volume" :: held 1.222s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:16:10 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Created reservations ['6e5b1c69-7f41-4da1-b7bc-ff1225257a78', '78a4034e-325e-4a73-b603-b493a3d8f3e0', '8ad97110-815f-4d09-bca9-a9a62a31092b', '05cddbe9-5a9f-4822-9c00-36811c74efc7'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:16:10 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_iq4oi34i" returned: 0 in 0.734s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:16:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:16:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:10 devstack sudo[103286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:16:10 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:11 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.535s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:11 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:16:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Deleted volume successfully.
Sep 25 15:16:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-faca2c71-236d-4051-bd73-a2069c69f6e6 tempest-TestStampPattern-365617491 None] Lock "cinder-54066646-3bb5-4f6c-af9a-b0bb52296bfe-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:16:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Acquiring lock "cinder-ab6adb3a-5624-40d6-9638-02b91172ec51-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Lock "cinder-ab6adb3a-5624-40d6-9638-02b91172ec51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Acquiring lock "cinder-quobyte-76ab0c1a-7c96-4767-aed4-b1bb4016c888" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Lock "cinder-quobyte-76ab0c1a-7c96-4767-aed4-b1bb4016c888" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Acquiring lock "cinder-quobyte-ab6adb3a-5624-40d6-9638-02b91172ec51" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Lock "cinder-quobyte-ab6adb3a-5624-40d6-9638-02b91172ec51" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Deleting offline snapshot ab6adb3a-5624-40d6-9638-02b91172ec51 of volume 76ab0c1a-7c96-4767-aed4-b1bb4016c888 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:16:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] snapshot_file for this snap is: volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:16:12 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0f3ac2-fdc0-419e-b6ca-6f758c1f7911]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:16:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:12 devstack sudo[103326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51
Sep 25 15:16:12 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:12 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51" returned: 0 in 0.608s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:16:12 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[13585350-92e0-4d9c-acd8-a12dd6ec5569]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:16:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:13 devstack sudo[103349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888
Sep 25 15:16:13 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 17.799s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Uploaded volume to glance image-id: 1ded21ff-157c-46c5-aebb-3da67bf3dded. {{(pid=87071) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 25 15:16:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-dc5e6a5b-047f-461d-b85b-12bed33fee3c tempest-VolumesActionsTest-1020599487 None] Copy volume to image completed successfully.
Sep 25 15:16:13 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888" returned: 0 in 0.646s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:13 devstack sudo[103354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51
Sep 25 15:16:13 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:14 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51" returned: 0 in 0.604s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:14 devstack sudo[103361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51
Sep 25 15:16:14 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:14 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888.ab6adb3a-5624-40d6-9638-02b91172ec51" returned: 0 in 0.490s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Lock "cinder-quobyte-ab6adb3a-5624-40d6-9638-02b91172ec51" released by "_delete_snapshot" :: held 2.579s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:16:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Lock "cinder-quobyte-76ab0c1a-7c96-4767-aed4-b1bb4016c888" released by "delete_snapshot" :: held 2.642s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:16:14 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Created reservations ['1a21b468-27a1-4f63-bc09-ed0ea0099f13', '70dc6c19-e3f2-449f-b7a6-d6b5df3fd7ec', '14fe2791-a0d6-4e5f-a396-99765fc61acf', 'c5bbe256-d06e-4512-b152-55aaf47e19fe'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:16:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Acquiring lock "cinder-c7725385-5ee2-42b6-8e67-e5d63355f7b5-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Lock "cinder-c7725385-5ee2-42b6-8e67-e5d63355f7b5-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Delete snapshot completed successfully.
Sep 25 15:16:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-200cc182-ca78-47d2-aa5a-e7fab964ed9b tempest-TestStampPattern-365617491 None] Lock "cinder-ab6adb3a-5624-40d6-9638-02b91172ec51-delete_snapshot" released by "delete_snapshot" :: held 3.014s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:16:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Acquiring lock "cinder-quobyte-c7725385-5ee2-42b6-8e67-e5d63355f7b5" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Lock "cinder-quobyte-c7725385-5ee2-42b6-8e67-e5d63355f7b5" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:15 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1972074-e345-4725-92b3-28272438eb51]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:16:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:15 devstack sudo[103364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5
Sep 25 15:16:15 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:15 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5" returned: 0 in 0.620s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:15 devstack sudo[103370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5
Sep 25 15:16:15 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:16 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c7725385-5ee2-42b6-8e67-e5d63355f7b5" returned: 0 in 0.332s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Lock "cinder-quobyte-c7725385-5ee2-42b6-8e67-e5d63355f7b5" released by "delete_volume" :: held 1.036s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:16:16 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Created reservations ['dca9ae98-3d85-463c-8437-345b0a19ba55', '9f67773c-4948-4bbf-8f4e-9f3f4bb7d34b', 'f3d29ccf-9379-4f70-ad3a-acfb66fb20c2', '26d5b6d7-d5f7-4a0d-a139-96603e31a740'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:16:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:16:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:16:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:16 devstack sudo[103396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:16:16 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:16 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.342s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:16 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:16:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Deleted volume successfully.
Sep 25 15:16:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2b83ffa1-581c-4b02-a8cd-0acbcded5a48 tempest-VolumesActionsTest-1020599487 None] Lock "cinder-c7725385-5ee2-42b6-8e67-e5d63355f7b5-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:16:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:16:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:16:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:16:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:20 devstack sudo[103431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:16:20 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:21 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.341s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:16:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:16:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 29 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:16:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>, <Thread(Rabbit-heartbeat, started daemon 129983531771584)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:16:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Acquiring lock "cinder-76ab0c1a-7c96-4767-aed4-b1bb4016c888-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Lock "cinder-76ab0c1a-7c96-4767-aed4-b1bb4016c888-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Acquiring lock "cinder-quobyte-76ab0c1a-7c96-4767-aed4-b1bb4016c888" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Lock "cinder-quobyte-76ab0c1a-7c96-4767-aed4-b1bb4016c888" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[40514ef7-bcd7-466e-873e-ade4d6edf700]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:16:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:21 devstack sudo[103434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888
Sep 25 15:16:21 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:22 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888" returned: 0 in 0.492s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:22 devstack sudo[103439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888
Sep 25 15:16:22 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:22 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-76ab0c1a-7c96-4767-aed4-b1bb4016c888" returned: 0 in 0.391s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Lock "cinder-quobyte-76ab0c1a-7c96-4767-aed4-b1bb4016c888" released by "delete_volume" :: held 0.979s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:16:22 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Created reservations ['10282de0-6452-411d-a57e-3828570703f4', '76386c28-b124-4839-9665-7865a6980d9b', '2a60056b-9e0a-4cc7-a33a-5faf28f75ae1', 'e5d72eb6-04db-4b05-b77f-0707d3995370'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:16:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:16:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:16:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:22 devstack sudo[103443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:16:22 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:22 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.273s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:22 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:16:22 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Deleted volume successfully.
Sep 25 15:16:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-51ebdf13-de71-4881-b063-a5affe9784d8 tempest-TestStampPattern-365617491 None] Lock "cinder-76ab0c1a-7c96-4767-aed4-b1bb4016c888-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:16:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Acquiring lock "cinder-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Lock "cinder-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Acquiring lock "cinder-quobyte-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Lock "cinder-quobyte-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9716d0e7-8acb-4664-bc90-40f922e0782c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:16:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:28 devstack sudo[103452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac
Sep 25 15:16:28 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:29 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac" returned: 0 in 0.564s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:29 devstack sudo[103457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac
Sep 25 15:16:29 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:29 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac" returned: 0 in 0.309s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Lock "cinder-quobyte-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac" released by "delete_volume" :: held 0.938s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:16:29 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Created reservations ['f4a65c42-1ae7-4298-ba25-8abeb6f69d8c', '429fd4ac-6209-46bb-934a-d1f8b878ea1d', '123323e0-c86b-4624-b8aa-1cd12af3f39d', 'ab929e21-4818-4913-942e-6907ee64c06d'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:16:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:16:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:16:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:29 devstack sudo[103460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:16:29 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:30 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.312s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:30 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:16:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Deleted volume successfully.
Sep 25 15:16:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1be4f0dd-67f2-453f-b88a-97f2a50bcd78 tempest-VolumesNegativeTest-145747697 None] Lock "cinder-54ea4b3f-4d3d-4352-a4d0-8c004ce6d1ac-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:16:39 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=26,cinder:INSERT=9,cinder:UPDATE=45 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:16:40 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=39,cinder:UPDATE=36,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Flow 'volume_create_manager' (4ddbdf40-8f92-4775-b6cc-dafc9da3e156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7840a2a4-5636-4f77-b9e1-5f05eb663ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7840a2a4-5636-4f77-b9e1-5f05eb663ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1560151665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0647416-310a-4882-b2da-08ad3581fcaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306e0d416b4d4f5493940bb7a3cac6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:16:47Z,use_quota=True,user_id='289f6effa90d43b8972278083059a396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69d6484-8cc8-4d83-a807-2212135b9fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69d6484-8cc8-4d83-a807-2212135b9fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e781353-a26e-483a-81fb-09f11629b044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e781353-a26e-483a-81fb-09f11629b044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0647416-310a-4882-b2da-08ad3581fcaf', 'volume_name': 'volume-a0647416-310a-4882-b2da-08ad3581fcaf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f35fa6-8027-4df7-a38b-e5151494a0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f35fa6-8027-4df7-a38b-e5151494a0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b87547-821f-421d-902e-fc61276518c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:46 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Volume a0647416-310a-4882-b2da-08ad3581fcaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0647416-310a-4882-b2da-08ad3581fcaf', 'volume_size': 1}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1560151665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0647416-310a-4882-b2da-08ad3581fcaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306e0d416b4d4f5493940bb7a3cac6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:16:47Z,use_quota=True,user_id='289f6effa90d43b8972278083059a396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Creating volume a0647416-310a-4882-b2da-08ad3581fcaf {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:16:46 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:16:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a0647416-310a-4882-b2da-08ad3581fcaf 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:46 devstack sudo[103468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a0647416-310a-4882-b2da-08ad3581fcaf 1073741824
Sep 25 15:16:46 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:47 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:16:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Flow 'volume_create_manager' (db210885-f020-4138-b1bb-c07c5c075a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:16:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e613e968-593f-4b81-b660-9794da43e84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e613e968-593f-4b81-b660-9794da43e84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-720854326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53dafda0-dd06-4f28-b05f-14b9518b12a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306e0d416b4d4f5493940bb7a3cac6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:16:47Z,use_quota=True,user_id='289f6effa90d43b8972278083059a396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fc9bdc-0a8b-4527-8ef8-81d8e326235a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fc9bdc-0a8b-4527-8ef8-81d8e326235a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f718e5-6093-4bbb-a7b6-64cd94a5373b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f718e5-6093-4bbb-a7b6-64cd94a5373b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53dafda0-dd06-4f28-b05f-14b9518b12a8', 'volume_name': 'volume-53dafda0-dd06-4f28-b05f-14b9518b12a8', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:47 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e833dc6-fcc4-4e29-b08a-ac3e6eac4821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e833dc6-fcc4-4e29-b08a-ac3e6eac4821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781504e7-9358-4450-bd83-5319402585a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Volume 53dafda0-dd06-4f28-b05f-14b9518b12a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53dafda0-dd06-4f28-b05f-14b9518b12a8', 'volume_size': 1}
Sep 25 15:16:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a0647416-310a-4882-b2da-08ad3581fcaf 1073741824" returned: 0 in 0.809s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a0647416-310a-4882-b2da-08ad3581fcaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:47 devstack sudo[103475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a0647416-310a-4882-b2da-08ad3581fcaf
Sep 25 15:16:47 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Flow 'volume_create_manager' (b45a13ca-95b7-4414-a8d7-375e8ab618ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0cb377-d0aa-406e-8aa1-a93d6aa3cbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:48 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0cb377-d0aa-406e-8aa1-a93d6aa3cbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1542518851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d685b0-5223-42ef-ad9c-233dc9dfb4ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306e0d416b4d4f5493940bb7a3cac6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:16:48Z,use_quota=True,user_id='289f6effa90d43b8972278083059a396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab9d498-4c07-4f0b-93f1-740b539bcfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab9d498-4c07-4f0b-93f1-740b539bcfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1e862e-0d32-41e7-9fbb-d4c9f0ea3436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1e862e-0d32-41e7-9fbb-d4c9f0ea3436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d685b0-5223-42ef-ad9c-233dc9dfb4ef', 'volume_name': 'volume-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c626f4f-1d2b-44ae-b958-66e3461bd363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c626f4f-1d2b-44ae-b958-66e3461bd363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe7ecd8-a1f6-44e5-b108-91777e7dca6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:48 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Volume b9d685b0-5223-42ef-ad9c-233dc9dfb4ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef', 'volume_size': 1}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a0647416-310a-4882-b2da-08ad3581fcaf" returned: 0 in 0.481s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.558s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-720854326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53dafda0-dd06-4f28-b05f-14b9518b12a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306e0d416b4d4f5493940bb7a3cac6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:16:47Z,use_quota=True,user_id='289f6effa90d43b8972278083059a396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Creating volume 53dafda0-dd06-4f28-b05f-14b9518b12a8 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:16:48 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53dafda0-dd06-4f28-b05f-14b9518b12a8 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:48 devstack sudo[103478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53dafda0-dd06-4f28-b05f-14b9518b12a8 1073741824
Sep 25 15:16:48 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b87547-821f-421d-902e-fc61276518c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0647416-310a-4882-b2da-08ad3581fcaf', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2713e0b-7cd1-4235-88fd-5eb4fab36854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:48 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Volume volume-a0647416-310a-4882-b2da-08ad3581fcaf (a0647416-310a-4882-b2da-08ad3581fcaf): created successfully
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2713e0b-7cd1-4235-88fd-5eb4fab36854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Flow 'volume_create_manager' (4ddbdf40-8f92-4775-b6cc-dafc9da3e156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:16:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c6f08b91-bf0a-4f2d-b9cd-08bc3b7d941f tempest-CreateVolumesFromImageTest-626572956 None] Created volume successfully.
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Flow 'volume_create_manager' (cc64fdac-d96a-41dd-9583-1cedeefa00c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898bf54f-9e7d-400e-96d8-2712926b7e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898bf54f-9e7d-400e-96d8-2712926b7e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-786954484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0781acf-359e-40b3-b394-a0d4f9fa075b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306e0d416b4d4f5493940bb7a3cac6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:16:49Z,use_quota=True,user_id='289f6effa90d43b8972278083059a396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f32ee740-c1cf-41ff-a0dc-0c8c716874a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f32ee740-c1cf-41ff-a0dc-0c8c716874a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59e1bb0-56e8-4da5-9ded-02621bac73fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59e1bb0-56e8-4da5-9ded-02621bac73fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0781acf-359e-40b3-b394-a0d4f9fa075b', 'volume_name': 'volume-e0781acf-359e-40b3-b394-a0d4f9fa075b', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbd73fa-b57d-4aa6-ae40-5ae1f85bf6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbd73fa-b57d-4aa6-ae40-5ae1f85bf6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (740e8c8b-3b8f-4c82-8d40-e61d0e535620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:48 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Volume e0781acf-359e-40b3-b394-a0d4f9fa075b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0781acf-359e-40b3-b394-a0d4f9fa075b', 'volume_size': 1}
Sep 25 15:16:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:49 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53dafda0-dd06-4f28-b05f-14b9518b12a8 1073741824" returned: 0 in 0.928s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53dafda0-dd06-4f28-b05f-14b9518b12a8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:49 devstack sudo[103484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53dafda0-dd06-4f28-b05f-14b9518b12a8
Sep 25 15:16:49 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Flow 'volume_create_manager' (9170e551-16a7-4e7a-845a-2019be6cabb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9ba5ad-a2eb-4782-8ade-7b733051b955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9ba5ad-a2eb-4782-8ade-7b733051b955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2007754904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691354d8-23b1-40d5-814a-c8d73577af43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306e0d416b4d4f5493940bb7a3cac6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:16:49Z,use_quota=True,user_id='289f6effa90d43b8972278083059a396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6836991-1872-456d-a7eb-59f49e95c5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6836991-1872-456d-a7eb-59f49e95c5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d461c23a-bdea-465f-8445-efd726c90b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d461c23a-bdea-465f-8445-efd726c90b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '691354d8-23b1-40d5-814a-c8d73577af43', 'volume_name': 'volume-691354d8-23b1-40d5-814a-c8d73577af43', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7467f26-c49f-4540-9838-30e70415e064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7467f26-c49f-4540-9838-30e70415e064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5c5e83-f90b-465b-bec7-8bfee708e46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:49 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Volume 691354d8-23b1-40d5-814a-c8d73577af43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-691354d8-23b1-40d5-814a-c8d73577af43', 'volume_size': 1}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:49 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53dafda0-dd06-4f28-b05f-14b9518b12a8" returned: 0 in 0.437s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.463s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1542518851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d685b0-5223-42ef-ad9c-233dc9dfb4ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306e0d416b4d4f5493940bb7a3cac6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:16:48Z,use_quota=True,user_id='289f6effa90d43b8972278083059a396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Creating volume b9d685b0-5223-42ef-ad9c-233dc9dfb4ef {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:16:49 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781504e7-9358-4450-bd83-5319402585a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53dafda0-dd06-4f28-b05f-14b9518b12a8', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:49 devstack sudo[103487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef 1073741824
Sep 25 15:16:49 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe250656-bff2-44ab-a6ed-8dcfbbc45200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:49 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Volume volume-53dafda0-dd06-4f28-b05f-14b9518b12a8 (53dafda0-dd06-4f28-b05f-14b9518b12a8): created successfully
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe250656-bff2-44ab-a6ed-8dcfbbc45200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Flow 'volume_create_manager' (db210885-f020-4138-b1bb-c07c5c075a77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:16:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5a9ae65c-cda5-4ee7-94b1-5e29cb54bf2d tempest-CreateVolumesFromImageTest-626572956 None] Created volume successfully.
Sep 25 15:16:50 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef 1073741824" returned: 0 in 0.646s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:50 devstack sudo[103494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef
Sep 25 15:16:50 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:50 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef" returned: 0 in 0.331s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.906s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-786954484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0781acf-359e-40b3-b394-a0d4f9fa075b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306e0d416b4d4f5493940bb7a3cac6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:16:49Z,use_quota=True,user_id='289f6effa90d43b8972278083059a396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Creating volume e0781acf-359e-40b3-b394-a0d4f9fa075b {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:16:50 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e0781acf-359e-40b3-b394-a0d4f9fa075b 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe7ecd8-a1f6-44e5-b108-91777e7dca6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:50 devstack sudo[103497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e0781acf-359e-40b3-b394-a0d4f9fa075b 1073741824
Sep 25 15:16:50 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aef585f-e958-485b-8874-c952905bf3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:50 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Volume volume-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef (b9d685b0-5223-42ef-ad9c-233dc9dfb4ef): created successfully
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aef585f-e958-485b-8874-c952905bf3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Flow 'volume_create_manager' (b45a13ca-95b7-4414-a8d7-375e8ab618ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:16:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a904073d-7ad0-478c-8ee7-6bd7c689477a tempest-CreateVolumesFromImageTest-626572956 None] Created volume successfully.
Sep 25 15:16:51 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e0781acf-359e-40b3-b394-a0d4f9fa075b 1073741824" returned: 0 in 0.564s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e0781acf-359e-40b3-b394-a0d4f9fa075b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:51 devstack sudo[103504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e0781acf-359e-40b3-b394-a0d4f9fa075b
Sep 25 15:16:51 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:51 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e0781acf-359e-40b3-b394-a0d4f9fa075b" returned: 0 in 0.514s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:16:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.461s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2007754904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691354d8-23b1-40d5-814a-c8d73577af43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306e0d416b4d4f5493940bb7a3cac6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:16:49Z,use_quota=True,user_id='289f6effa90d43b8972278083059a396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:16:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Creating volume 691354d8-23b1-40d5-814a-c8d73577af43 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:16:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:16:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:16:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:16:52 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:16:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-691354d8-23b1-40d5-814a-c8d73577af43 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (740e8c8b-3b8f-4c82-8d40-e61d0e535620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0781acf-359e-40b3-b394-a0d4f9fa075b', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf92caa-0929-4210-8811-aa208f8fb52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:52 devstack sudo[103507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-691354d8-23b1-40d5-814a-c8d73577af43 1073741824
Sep 25 15:16:52 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:52 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Volume volume-e0781acf-359e-40b3-b394-a0d4f9fa075b (e0781acf-359e-40b3-b394-a0d4f9fa075b): created successfully
Sep 25 15:16:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf92caa-0929-4210-8811-aa208f8fb52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Flow 'volume_create_manager' (cc64fdac-d96a-41dd-9583-1cedeefa00c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:16:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-29e5cd09-0e4c-4dc3-8559-853944e25fb3 tempest-CreateVolumesFromImageTest-626572956 None] Created volume successfully.
Sep 25 15:16:52 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-691354d8-23b1-40d5-814a-c8d73577af43 1073741824" returned: 0 in 0.641s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-691354d8-23b1-40d5-814a-c8d73577af43 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:52 devstack sudo[103515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-691354d8-23b1-40d5-814a-c8d73577af43
Sep 25 15:16:52 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:53 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-691354d8-23b1-40d5-814a-c8d73577af43" returned: 0 in 0.410s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:16:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5c5e83-f90b-465b-bec7-8bfee708e46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691354d8-23b1-40d5-814a-c8d73577af43', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabef192-6dc1-4f46-8e43-df4c18af3cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:16:53 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Volume volume-691354d8-23b1-40d5-814a-c8d73577af43 (691354d8-23b1-40d5-814a-c8d73577af43): created successfully
Sep 25 15:16:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabef192-6dc1-4f46-8e43-df4c18af3cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:16:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Flow 'volume_create_manager' (9170e551-16a7-4e7a-845a-2019be6cabb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:16:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-35279684-13a4-4761-a9eb-9573d1e250a8 tempest-CreateVolumesFromImageTest-626572956 None] Created volume successfully.
Sep 25 15:16:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "cinder-691354d8-23b1-40d5-814a-c8d73577af43-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-691354d8-23b1-40d5-814a-c8d73577af43-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "cinder-quobyte-691354d8-23b1-40d5-814a-c8d73577af43" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-quobyte-691354d8-23b1-40d5-814a-c8d73577af43" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:54 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1b18f5-e010-4320-b99d-c60c365b45b4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:16:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-691354d8-23b1-40d5-814a-c8d73577af43 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:54 devstack sudo[103519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-691354d8-23b1-40d5-814a-c8d73577af43
Sep 25 15:16:54 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:54 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-691354d8-23b1-40d5-814a-c8d73577af43" returned: 0 in 0.481s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-691354d8-23b1-40d5-814a-c8d73577af43 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:54 devstack sudo[103524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-691354d8-23b1-40d5-814a-c8d73577af43
Sep 25 15:16:54 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:55 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-691354d8-23b1-40d5-814a-c8d73577af43" returned: 0 in 0.359s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-quobyte-691354d8-23b1-40d5-814a-c8d73577af43" released by "delete_volume" :: held 0.901s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:16:55 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Created reservations ['cbfebe16-1038-414a-a73e-0040b399c6b5', '3e33c3a6-1336-465e-ae78-3b50acb36d67', 'b4c6d0a8-2ed4-4606-9a25-29f0caf8fe4d', '5ee532fc-e06f-441f-ae3a-9743c7399abb'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:16:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:16:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:16:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:55 devstack sudo[103530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:16:55 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:55 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.341s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:55 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:16:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Deleted volume successfully.
Sep 25 15:16:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-88beedb3-f196-4101-b733-5ce7331b634c tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-691354d8-23b1-40d5-814a-c8d73577af43-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:16:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "cinder-e0781acf-359e-40b3-b394-a0d4f9fa075b-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-e0781acf-359e-40b3-b394-a0d4f9fa075b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "cinder-quobyte-e0781acf-359e-40b3-b394-a0d4f9fa075b" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-quobyte-e0781acf-359e-40b3-b394-a0d4f9fa075b" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:56 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[71791125-1fe2-4f1e-9edf-747b2588dba2]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:16:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e0781acf-359e-40b3-b394-a0d4f9fa075b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:56 devstack sudo[103536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e0781acf-359e-40b3-b394-a0d4f9fa075b
Sep 25 15:16:56 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:57 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e0781acf-359e-40b3-b394-a0d4f9fa075b" returned: 0 in 0.566s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e0781acf-359e-40b3-b394-a0d4f9fa075b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:57 devstack sudo[103541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e0781acf-359e-40b3-b394-a0d4f9fa075b
Sep 25 15:16:57 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:57 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e0781acf-359e-40b3-b394-a0d4f9fa075b" returned: 0 in 0.354s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-quobyte-e0781acf-359e-40b3-b394-a0d4f9fa075b" released by "delete_volume" :: held 0.995s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:16:57 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Created reservations ['a17ac1e6-d462-4d23-b064-ebfaa5fcdbf4', '455da73f-6795-4751-946c-1a0f634b6c2b', '560eacc6-ec09-4aa2-ad81-cef0a1d67b2a', '65be57ef-1a02-43dc-a454-8c8f4c7fb104'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:16:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:16:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:16:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:57 devstack sudo[103544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:16:57 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:58 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.352s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:58 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:16:58 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Deleted volume successfully.
Sep 25 15:16:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1e9f707f-419f-4b4e-9ef9-e8b1237abc41 tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-e0781acf-359e-40b3-b394-a0d4f9fa075b-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:16:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "cinder-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "cinder-quobyte-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:16:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-quobyte-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:16:58 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a16e86-05f5-448d-9c9b-9b68febff14e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:16:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:59 devstack sudo[103548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef
Sep 25 15:16:59 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:59 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef" returned: 0 in 0.443s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:59 devstack sudo[103553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef
Sep 25 15:16:59 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:16:59 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root
Sep 25 15:16:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef" returned: 0 in 0.370s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:16:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-quobyte-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef" released by "delete_volume" :: held 0.886s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:16:59 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Created reservations ['727118df-95e0-4169-a089-c056400f5b30', 'b28ddfe7-612f-4fb8-a2ae-3a65ee2fc26e', '875415ec-136e-4922-969f-fea8c4464b84', '9455e326-c59e-43fd-9df6-d5bb1e730b48'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:16:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:16:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:16:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:16:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:16:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:16:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:16:59 devstack sudo[103556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:16:59 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "cinder-53dafda0-dd06-4f28-b05f-14b9518b12a8-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:17:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-53dafda0-dd06-4f28-b05f-14b9518b12a8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:17:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "cinder-quobyte-53dafda0-dd06-4f28-b05f-14b9518b12a8" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:17:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-quobyte-53dafda0-dd06-4f28-b05f-14b9518b12a8" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:17:00 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eea695-14a4-48dd-ad80-bc17b92fb77d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:17:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53dafda0-dd06-4f28-b05f-14b9518b12a8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:00 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.373s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:00 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:17:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Deleted volume successfully.
Sep 25 15:17:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a46e89a4-ef48-4b92-89b8-cbfb9db36029 tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-b9d685b0-5223-42ef-ad9c-233dc9dfb4ef-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:17:00 devstack sudo[103558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53dafda0-dd06-4f28-b05f-14b9518b12a8
Sep 25 15:17:00 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:00 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53dafda0-dd06-4f28-b05f-14b9518b12a8" returned: 0 in 0.538s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53dafda0-dd06-4f28-b05f-14b9518b12a8 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:00 devstack sudo[103564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53dafda0-dd06-4f28-b05f-14b9518b12a8
Sep 25 15:17:00 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:01 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-53dafda0-dd06-4f28-b05f-14b9518b12a8" returned: 0 in 0.383s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-quobyte-53dafda0-dd06-4f28-b05f-14b9518b12a8" released by "delete_volume" :: held 0.998s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:17:01 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Created reservations ['c675de2f-e759-41cd-bdd5-bb6fa212e002', '8ea9036f-a993-408f-8262-b9952c7939dd', '7ec01c42-6e6a-4cd5-a67e-f18bab4e6c13', '912ec963-10b6-4b2d-9e66-9ff3b80d6bcf'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:17:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:17:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:17:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:01 devstack sudo[103567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:17:01 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:01 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.301s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:01 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:17:01 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Deleted volume successfully.
Sep 25 15:17:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3a54b726-d05f-437c-b12e-2d27473e5843 tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-53dafda0-dd06-4f28-b05f-14b9518b12a8-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:17:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "cinder-a0647416-310a-4882-b2da-08ad3581fcaf-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:17:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-a0647416-310a-4882-b2da-08ad3581fcaf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:17:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "cinder-quobyte-a0647416-310a-4882-b2da-08ad3581fcaf" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:17:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-quobyte-a0647416-310a-4882-b2da-08ad3581fcaf" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:17:02 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23b181f-f91a-460e-8ea3-3337fd7bbcac]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:17:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a0647416-310a-4882-b2da-08ad3581fcaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:02 devstack sudo[103573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a0647416-310a-4882-b2da-08ad3581fcaf
Sep 25 15:17:02 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:03 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a0647416-310a-4882-b2da-08ad3581fcaf" returned: 0 in 0.484s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a0647416-310a-4882-b2da-08ad3581fcaf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:03 devstack sudo[103578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a0647416-310a-4882-b2da-08ad3581fcaf
Sep 25 15:17:03 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:03 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a0647416-310a-4882-b2da-08ad3581fcaf" returned: 0 in 0.315s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-quobyte-a0647416-310a-4882-b2da-08ad3581fcaf" released by "delete_volume" :: held 0.875s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:17:03 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Created reservations ['3343cd13-aaab-4f13-81d9-ad8d33521912', '10c991d0-dae5-41c4-ac97-c41f472dafb0', 'de63c13a-9574-4afc-9edb-74604b953969', '273b0b65-483e-42f9-b87f-72df1a765443'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:17:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:17:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:17:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:03 devstack sudo[103581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:17:03 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:03 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.418s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:03 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:17:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Deleted volume successfully.
Sep 25 15:17:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-83beb6a8-71bb-4c58-a9de-e2a0c92a1766 tempest-CreateVolumesFromImageTest-626572956 None] Lock "cinder-a0647416-310a-4882-b2da-08ad3581fcaf-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Flow 'volume_create_manager' (2914d2c7-a684-44bd-8202-eacb124927e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c07ad40-a7cd-40a4-b61c-f243a23ae5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c07ad40-a7cd-40a4-b61c-f243a23ae5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1191112883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a52d8a-3b51-44c5-ab41-82ceba96b78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d030e1d45393419589cfc2f59137daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:17:11Z,use_quota=True,user_id='451425098f404425adc9c1f0ce1a010e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a677e4-ef9c-41d6-a58a-e4abb3b3d614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a677e4-ef9c-41d6-a58a-e4abb3b3d614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c911bd3f-a169-4b0d-854c-e7bbd0e9980a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c911bd3f-a169-4b0d-854c-e7bbd0e9980a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8a52d8a-3b51-44c5-ab41-82ceba96b78e', 'volume_name': 'volume-d8a52d8a-3b51-44c5-ab41-82ceba96b78e', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a64250-88f0-4144-96d4-1c0ef0e2e057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a64250-88f0-4144-96d4-1c0ef0e2e057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8b50bf-75da-4bc0-b82e-7620176c6ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:11 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Volume d8a52d8a-3b51-44c5-ab41-82ceba96b78e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8a52d8a-3b51-44c5-ab41-82ceba96b78e', 'volume_size': 1}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1191112883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a52d8a-3b51-44c5-ab41-82ceba96b78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d030e1d45393419589cfc2f59137daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:17:11Z,use_quota=True,user_id='451425098f404425adc9c1f0ce1a010e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Creating volume d8a52d8a-3b51-44c5-ab41-82ceba96b78e {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:17:11 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a52d8a-3b51-44c5-ab41-82ceba96b78e 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:11 devstack sudo[103623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a52d8a-3b51-44c5-ab41-82ceba96b78e 1073741824
Sep 25 15:17:11 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:11 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a52d8a-3b51-44c5-ab41-82ceba96b78e 1073741824" returned: 0 in 0.686s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a52d8a-3b51-44c5-ab41-82ceba96b78e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:12 devstack sudo[103632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a52d8a-3b51-44c5-ab41-82ceba96b78e
Sep 25 15:17:12 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:12 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Flow 'volume_create_manager' (d4bea159-ddad-4700-aa15-7094c6a7377b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fdeee6-fb4c-4df3-9dbd-a7da03af37ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a52d8a-3b51-44c5-ab41-82ceba96b78e" returned: 0 in 0.412s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8b50bf-75da-4bc0-b82e-7620176c6ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a52d8a-3b51-44c5-ab41-82ceba96b78e', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d30a1e9-5ca7-4514-89db-39f640beec38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fdeee6-fb4c-4df3-9dbd-a7da03af37ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1774480568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9be4b27-f39c-49fa-b2b7-134f76dfd910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362d9df1b7e4ad5988a846cb33bc5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:17:12Z,use_quota=True,user_id='fa63b79aa2934835bce654d0ae54c0e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f13b552d-3da3-400a-9481-7aa99eb42358),volume_type_id=f13b552d-3da3-400a-9481-7aa99eb42358)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa99285c-268f-46fa-9f8e-2932200238ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa99285c-268f-46fa-9f8e-2932200238ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8017a257-ddfe-42a5-8249-5d4e5fe3f55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8017a257-ddfe-42a5-8249-5d4e5fe3f55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9be4b27-f39c-49fa-b2b7-134f76dfd910', 'volume_name': 'volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60001f58-d392-4fca-b067-ebf47f56bf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60001f58-d392-4fca-b067-ebf47f56bf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657429bb-9098-4c83-af4e-aa23e793eba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:12 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Volume a9be4b27-f39c-49fa-b2b7-134f76dfd910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910', 'volume_size': 1}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1774480568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9be4b27-f39c-49fa-b2b7-134f76dfd910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362d9df1b7e4ad5988a846cb33bc5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:17:12Z,use_quota=True,user_id='fa63b79aa2934835bce654d0ae54c0e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f13b552d-3da3-400a-9481-7aa99eb42358),volume_type_id=f13b552d-3da3-400a-9481-7aa99eb42358)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Creating volume a9be4b27-f39c-49fa-b2b7-134f76dfd910 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:17:12 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:12 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Volume volume-d8a52d8a-3b51-44c5-ab41-82ceba96b78e (d8a52d8a-3b51-44c5-ab41-82ceba96b78e): created successfully
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d30a1e9-5ca7-4514-89db-39f640beec38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:12 devstack sudo[103635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910 1073741824
Sep 25 15:17:12 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Flow 'volume_create_manager' (2914d2c7-a684-44bd-8202-eacb124927e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:17:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-102d0be1-5486-4bc3-912d-262ada54ab52 tempest-ProjectReaderTests-265796023 None] Created volume successfully.
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Flow 'volume_create_manager' (9be75dca-04d7-4b50-8476-4e6330cc1100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8beeae0a-e176-478b-aced-edf6c87b3e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8beeae0a-e176-478b-aced-edf6c87b3e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-165084278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2950305-b0f7-4fc0-9a40-bd496f5f78dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362d9df1b7e4ad5988a846cb33bc5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:17:13Z,use_quota=True,user_id='fa63b79aa2934835bce654d0ae54c0e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a1dbd97-3a71-4845-8d15-3b54ab866394),volume_type_id=7a1dbd97-3a71-4845-8d15-3b54ab866394)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b47a564-3e42-4fc7-a5c9-950fa535d5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b47a564-3e42-4fc7-a5c9-950fa535d5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649c098e-0921-4856-a892-d395588e391e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649c098e-0921-4856-a892-d395588e391e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2950305-b0f7-4fc0-9a40-bd496f5f78dc', 'volume_name': 'volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a6d7f4-8e01-466f-8476-57f7b5d24d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a6d7f4-8e01-466f-8476-57f7b5d24d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28beee2b-b790-490a-9896-87b6c29df6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:13 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Volume b2950305-b0f7-4fc0-9a40-bd496f5f78dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc', 'volume_size': 1}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:13 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910 1073741824" returned: 0 in 0.844s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:13 devstack sudo[103641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910
Sep 25 15:17:13 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Acquiring lock "cinder-d8a52d8a-3b51-44c5-ab41-82ceba96b78e-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:17:13 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910" returned: 0 in 0.435s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-165084278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2950305-b0f7-4fc0-9a40-bd496f5f78dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362d9df1b7e4ad5988a846cb33bc5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:17:13Z,use_quota=True,user_id='fa63b79aa2934835bce654d0ae54c0e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a1dbd97-3a71-4845-8d15-3b54ab866394),volume_type_id=7a1dbd97-3a71-4845-8d15-3b54ab866394)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Creating volume b2950305-b0f7-4fc0-9a40-bd496f5f78dc {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:17:13 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Lock "cinder-d8a52d8a-3b51-44c5-ab41-82ceba96b78e-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:17:14 devstack sudo[103645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc 1073741824
Sep 25 15:17:14 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657429bb-9098-4c83-af4e-aa23e793eba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7edd24-8779-418b-ac1d-43ef0e28634e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:14 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Volume volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910 (a9be4b27-f39c-49fa-b2b7-134f76dfd910): created successfully
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7edd24-8779-418b-ac1d-43ef0e28634e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Flow 'volume_create_manager' (d4bea159-ddad-4700-aa15-7094c6a7377b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Acquiring lock "cinder-quobyte-d8a52d8a-3b51-44c5-ab41-82ceba96b78e" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:17:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d4681deb-8b70-4dde-9381-5988071d1d85 tempest-TestInstancesWithCinderVolumes-314416230 None] Created volume successfully.
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Lock "cinder-quobyte-d8a52d8a-3b51-44c5-ab41-82ceba96b78e" acquired by "delete_volume" :: waited 0.056s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d837d3-f8cc-4e26-89b5-ea01a05012c8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a52d8a-3b51-44c5-ab41-82ceba96b78e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Flow 'volume_create_manager' (1d8ef55c-f993-479c-99f2-532b42c40b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec754b4-eaaf-49ff-ba55-686c7d16e527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:14 devstack sudo[103650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a52d8a-3b51-44c5-ab41-82ceba96b78e
Sep 25 15:17:14 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec754b4-eaaf-49ff-ba55-686c7d16e527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-145405969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b99253-d698-4029-a7ea-0d56d56b2739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362d9df1b7e4ad5988a846cb33bc5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:17:14Z,use_quota=True,user_id='fa63b79aa2934835bce654d0ae54c0e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cb9a0e0-75b8-439c-a7ce-0ff45d30b0a1),volume_type_id=7cb9a0e0-75b8-439c-a7ce-0ff45d30b0a1)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e92f65e8-8d92-4ba4-99b9-c43ff8248a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e92f65e8-8d92-4ba4-99b9-c43ff8248a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b5df5f-1e14-4021-8540-025ba9034b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 15:17:14 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc 1073741824" returned: 0 in 0.961s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:14 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a52d8a-3b51-44c5-ab41-82ceba96b78e" returned: 0 in 0.693s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a52d8a-3b51-44c5-ab41-82ceba96b78e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:14 devstack sudo[103672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a52d8a-3b51-44c5-ab41-82ceba96b78e
Sep 25 15:17:14 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:15 devstack sudo[103674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc
Sep 25 15:17:15 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:15 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d8a52d8a-3b51-44c5-ab41-82ceba96b78e" returned: 0 in 0.582s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:15 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Lock "cinder-quobyte-d8a52d8a-3b51-44c5-ab41-82ceba96b78e" released by "delete_volume" :: held 1.383s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc" returned: 0 in 0.550s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28beee2b-b790-490a-9896-87b6c29df6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6083d0a2-95ed-415d-9a66-91b231f0ebb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b5df5f-1e14-4021-8540-025ba9034b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06b99253-d698-4029-a7ea-0d56d56b2739', 'volume_name': 'volume-06b99253-d698-4029-a7ea-0d56d56b2739', 'volume_size': 1, 'image_id': '42cb596e-9f13-411f-ac0d-e61010c8111c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42cb596e-9f13-411f-ac0d-e61010c8111c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1226323854', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c362d9df1b7e4ad5988a846cb33bc5dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '42cb596e-9f13-411f-ac0d-e61010c8111c', 'created_at': datetime.datetime(2026, 9, 25, 13, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 17, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42cb596e-9f13-411f-ac0d-e61010c8111c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7638263d13d0>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90d4ed8-9d18-439c-b99e-b6e684f1887d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90d4ed8-9d18-439c-b99e-b6e684f1887d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97f2285-a2a3-4d1d-aad8-fd08dac27908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Volume 06b99253-d698-4029-a7ea-0d56d56b2739: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06b99253-d698-4029-a7ea-0d56d56b2739', 'volume_size': 1, 'image_id': '42cb596e-9f13-411f-ac0d-e61010c8111c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42cb596e-9f13-411f-ac0d-e61010c8111c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1226323854', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c362d9df1b7e4ad5988a846cb33bc5dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '42cb596e-9f13-411f-ac0d-e61010c8111c', 'created_at': datetime.datetime(2026, 9, 25, 13, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 17, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42cb596e-9f13-411f-ac0d-e61010c8111c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7638263d13d0>}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Trying to clone 06b99253-d698-4029-a7ea-0d56d56b2739 from image 42cb596e-9f13-411f-ac0d-e61010c8111c at location (None, [{'url': 'file:///opt/stack/data/glance/images/42cb596e-9f13-411f-ac0d-e61010c8111c', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 15:17:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Volume volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc (b2950305-b0f7-4fc0-9a40-bd496f5f78dc): created successfully
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6083d0a2-95ed-415d-9a66-91b231f0ebb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Flow 'volume_create_manager' (9be75dca-04d7-4b50-8476-4e6330cc1100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:17:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-58c5b150-b14b-48e3-83dd-a5adfdefda9f tempest-TestInstancesWithCinderVolumes-314416230 None] Created volume successfully.
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Created reservations ['d382ef48-7338-4d70-88df-38a73c34b97d', '1eeabe4f-dc53-4e6b-9f8e-1857573fae78', '3a12659d-0e63-4fbe-8592-ba726d3c7af9', 'afcb5150-9b3f-46ca-a83c-f844a6a537ca'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:15 devstack sudo[103678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:17:15 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:16 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.394s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:16 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:17:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Deleted volume successfully.
Sep 25 15:17:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d08d6248-dbae-4297-b24a-05e1ae6d3d4f tempest-ProjectReaderTests-265796023 None] Lock "cinder-d8a52d8a-3b51-44c5-ab41-82ceba96b78e-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Flow 'volume_create_manager' (1ae07c25-4991-4042-bdea-6557ee2935bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1db7bd-5ecf-4c4f-bd85-74f2cb565ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1db7bd-5ecf-4c4f-bd85-74f2cb565ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1641482241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a800023-7a15-463d-941a-468873eb3bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d030e1d45393419589cfc2f59137daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:17:17Z,use_quota=True,user_id='451425098f404425adc9c1f0ce1a010e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc0aec6-0388-479c-83c8-8759bbb9a3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc0aec6-0388-479c-83c8-8759bbb9a3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (055b3edd-604b-4f62-9973-fdb6b1b344e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (055b3edd-604b-4f62-9973-fdb6b1b344e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a800023-7a15-463d-941a-468873eb3bd4', 'volume_name': 'volume-7a800023-7a15-463d-941a-468873eb3bd4', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2605e64-acbe-4a0a-8159-1287b8af1c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2605e64-acbe-4a0a-8159-1287b8af1c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9c32c5-4d31-4138-aea1-93945d7c6c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:17 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Volume 7a800023-7a15-463d-941a-468873eb3bd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a800023-7a15-463d-941a-468873eb3bd4', 'volume_size': 1}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1641482241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a800023-7a15-463d-941a-468873eb3bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d030e1d45393419589cfc2f59137daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:17:17Z,use_quota=True,user_id='451425098f404425adc9c1f0ce1a010e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Creating volume 7a800023-7a15-463d-941a-468873eb3bd4 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:17:17 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:17:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a800023-7a15-463d-941a-468873eb3bd4 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:17 devstack sudo[103682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a800023-7a15-463d-941a-468873eb3bd4 1073741824
Sep 25 15:17:17 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:18 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a800023-7a15-463d-941a-468873eb3bd4 1073741824" returned: 0 in 0.903s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a800023-7a15-463d-941a-468873eb3bd4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:18 devstack sudo[103723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a800023-7a15-463d-941a-468873eb3bd4
Sep 25 15:17:18 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:18 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a800023-7a15-463d-941a-468873eb3bd4" returned: 0 in 0.495s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:17:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9c32c5-4d31-4138-aea1-93945d7c6c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a800023-7a15-463d-941a-468873eb3bd4', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea19a58-a277-4398-922c-48560c99855a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:18 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Volume volume-7a800023-7a15-463d-941a-468873eb3bd4 (7a800023-7a15-463d-941a-468873eb3bd4): created successfully
Sep 25 15:17:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea19a58-a277-4398-922c-48560c99855a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Flow 'volume_create_manager' (1ae07c25-4991-4042-bdea-6557ee2935bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:17:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f57bcb29-b03d-42a1-b640-e1d4c172f8ce tempest-ProjectReaderTests-265796023 None] Created volume successfully.
Sep 25 15:17:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Acquiring lock "cinder-7a800023-7a15-463d-941a-468873eb3bd4-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:17:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Lock "cinder-7a800023-7a15-463d-941a-468873eb3bd4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:17:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Acquiring lock "cinder-quobyte-7a800023-7a15-463d-941a-468873eb3bd4" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:17:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Lock "cinder-quobyte-7a800023-7a15-463d-941a-468873eb3bd4" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:17:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6389a307-39d4-45cd-b4f9-f48c1ed6f2e1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:17:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a800023-7a15-463d-941a-468873eb3bd4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:19 devstack sudo[103763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a800023-7a15-463d-941a-468873eb3bd4
Sep 25 15:17:19 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:20 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a800023-7a15-463d-941a-468873eb3bd4" returned: 0 in 0.534s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a800023-7a15-463d-941a-468873eb3bd4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:20 devstack sudo[103778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a800023-7a15-463d-941a-468873eb3bd4
Sep 25 15:17:20 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:20 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a800023-7a15-463d-941a-468873eb3bd4" returned: 0 in 0.300s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Lock "cinder-quobyte-7a800023-7a15-463d-941a-468873eb3bd4" released by "delete_volume" :: held 0.898s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Created reservations ['00b55507-2c8e-4520-9f2a-3a9da1b36203', '079cafc3-7ab9-42fb-a223-9f1297dc61fe', '4ed14891-c221-4b32-a010-53d569cb2ca8', 'b51b1e88-4167-4201-9505-5573f7be54ed'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:20 devstack sudo[103781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:17:20 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:20 devstack sudo[103785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:17:20 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:21 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.469s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:17:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Deleted volume successfully.
Sep 25 15:17:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1f8447bb-4ce2-48b1-8b59-9e5ea0b0ff94 tempest-ProjectReaderTests-265796023 None] Lock "cinder-7a800023-7a15-463d-941a-468873eb3bd4-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:17:21 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.640s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:17:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:17:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 29 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:17:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>, <Thread(Rabbit-heartbeat, started daemon 129983531771584)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:17:21 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_42cb596e-9f13-411f-ac0d-e61010c8111c_yr59jyoedevstack@QuobyteHD, size 20.69 MB, duration 6.24 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 15:17:21 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Image download 20.69 MB at 3.31 MB/s
Sep 25 15:17:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5307591-5b85-4638-8621-c063d17cda12]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:17:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42cb596e-9f13-411f-ac0d-e61010c8111c_yr59jyoedevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:22 devstack sudo[103789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42cb596e-9f13-411f-ac0d-e61010c8111c_yr59jyoedevstack@QuobyteHD
Sep 25 15:17:22 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Flow 'volume_create_manager' (b92df91c-1dfc-424e-bf70-b4d24322f179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9197ce8-3d20-4466-857b-822b6f87982f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9197ce8-3d20-4466-857b-822b6f87982f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-852196508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=840af75c-90f4-44be-bc79-8ea8348c18e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d030e1d45393419589cfc2f59137daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:17:22Z,use_quota=True,user_id='451425098f404425adc9c1f0ce1a010e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:22 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e390ae9-bfbb-4ca5-9e9b-362091e4d637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e390ae9-bfbb-4ca5-9e9b-362091e4d637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90927a2-a81e-46ab-b92a-dfe04dafb247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90927a2-a81e-46ab-b92a-dfe04dafb247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '840af75c-90f4-44be-bc79-8ea8348c18e4', 'volume_name': 'volume-840af75c-90f4-44be-bc79-8ea8348c18e4', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009b2c69-e46f-44dd-82c4-642efb6cbda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009b2c69-e46f-44dd-82c4-642efb6cbda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc60e4c7-6d73-453d-9868-30a2665106e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:22 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Volume 840af75c-90f4-44be-bc79-8ea8348c18e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-840af75c-90f4-44be-bc79-8ea8348c18e4', 'volume_size': 1}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-852196508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=840af75c-90f4-44be-bc79-8ea8348c18e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d030e1d45393419589cfc2f59137daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:17:22Z,use_quota=True,user_id='451425098f404425adc9c1f0ce1a010e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Creating volume 840af75c-90f4-44be-bc79-8ea8348c18e4 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:17:22 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-840af75c-90f4-44be-bc79-8ea8348c18e4 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42cb596e-9f13-411f-ac0d-e61010c8111c_yr59jyoedevstack@QuobyteHD" returned: 0 in 0.617s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Temporary image 42cb596e-9f13-411f-ac0d-e61010c8111c is fetched for user fa63b79aa2934835bce654d0ae54c0e5. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 15:17:22 devstack sudo[103795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-840af75c-90f4-44be-bc79-8ea8348c18e4 1073741824
Sep 25 15:17:22 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56136fd-0241-4582-bfa1-b1fa4df4f347]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:17:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42cb596e-9f13-411f-ac0d-e61010c8111c_yr59jyoedevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:22 devstack sudo[103797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42cb596e-9f13-411f-ac0d-e61010c8111c_yr59jyoedevstack@QuobyteHD
Sep 25 15:17:22 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:23 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42cb596e-9f13-411f-ac0d-e61010c8111c_yr59jyoedevstack@QuobyteHD" returned: 0 in 0.511s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:23 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-840af75c-90f4-44be-bc79-8ea8348c18e4 1073741824" returned: 0 in 0.704s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-840af75c-90f4-44be-bc79-8ea8348c18e4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:23 devstack sudo[103808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-840af75c-90f4-44be-bc79-8ea8348c18e4
Sep 25 15:17:23 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:23 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-840af75c-90f4-44be-bc79-8ea8348c18e4" returned: 0 in 0.338s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.482s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-145405969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b99253-d698-4029-a7ea-0d56d56b2739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362d9df1b7e4ad5988a846cb33bc5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:17:14Z,use_quota=True,user_id='fa63b79aa2934835bce654d0ae54c0e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cb9a0e0-75b8-439c-a7ce-0ff45d30b0a1),volume_type_id=7cb9a0e0-75b8-439c-a7ce-0ff45d30b0a1)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Creating volume 06b99253-d698-4029-a7ea-0d56d56b2739 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:17:23 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc60e4c7-6d73-453d-9868-30a2665106e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-840af75c-90f4-44be-bc79-8ea8348c18e4', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:23 devstack sudo[103811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739 1073741824
Sep 25 15:17:23 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2923d9ad-e3f5-4e13-b0b6-5db621d234a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:23 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Volume volume-840af75c-90f4-44be-bc79-8ea8348c18e4 (840af75c-90f4-44be-bc79-8ea8348c18e4): created successfully
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2923d9ad-e3f5-4e13-b0b6-5db621d234a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Flow 'volume_create_manager' (b92df91c-1dfc-424e-bf70-b4d24322f179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:17:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-73099f4d-bd56-46a4-bda2-8c87c3e0574e tempest-ProjectReaderTests-265796023 None] Created volume successfully.
Sep 25 15:17:24 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739 1073741824" returned: 0 in 0.643s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:24 devstack sudo[103817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739
Sep 25 15:17:24 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Acquiring lock "cinder-840af75c-90f4-44be-bc79-8ea8348c18e4-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:17:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Lock "cinder-840af75c-90f4-44be-bc79-8ea8348c18e4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:17:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Acquiring lock "cinder-quobyte-840af75c-90f4-44be-bc79-8ea8348c18e4" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:17:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Lock "cinder-quobyte-840af75c-90f4-44be-bc79-8ea8348c18e4" acquired by "delete_volume" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:17:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[588cfa57-d283-471b-8018-4fff251aefe7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:17:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-840af75c-90f4-44be-bc79-8ea8348c18e4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:24 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739" returned: 0 in 0.511s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:17:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:24 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Attempting download of 42cb596e-9f13-411f-ac0d-e61010c8111c ((None, [{'url': 'file:///opt/stack/data/glance/images/42cb596e-9f13-411f-ac0d-e61010c8111c', 'metadata': {}}])) to volume 06b99253-d698-4029-a7ea-0d56d56b2739. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 15:17:25 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[db35393b-c799-404f-8b08-f8a20b322d7c]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:17:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42cb596e-9f13-411f-ac0d-e61010c8111c_kqcwdefr {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:25 devstack sudo[103821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-840af75c-90f4-44be-bc79-8ea8348c18e4
Sep 25 15:17:25 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:25 devstack sudo[103822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42cb596e-9f13-411f-ac0d-e61010c8111c_kqcwdefr
Sep 25 15:17:25 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:25 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-840af75c-90f4-44be-bc79-8ea8348c18e4" returned: 0 in 0.506s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-840af75c-90f4-44be-bc79-8ea8348c18e4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:25 devstack sudo[103829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-840af75c-90f4-44be-bc79-8ea8348c18e4
Sep 25 15:17:25 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:25 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42cb596e-9f13-411f-ac0d-e61010c8111c_kqcwdefr" returned: 0 in 0.441s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42cb596e-9f13-411f-ac0d-e61010c8111c_kqcwdefr {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:25 devstack sudo[103833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42cb596e-9f13-411f-ac0d-e61010c8111c_kqcwdefr
Sep 25 15:17:25 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:25 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-840af75c-90f4-44be-bc79-8ea8348c18e4" returned: 0 in 0.289s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Lock "cinder-quobyte-840af75c-90f4-44be-bc79-8ea8348c18e4" released by "delete_volume" :: held 0.897s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:17:25 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Created reservations ['2a3c923d-9b60-49b3-9fd2-a291a863f104', '8f346894-656e-4c20-9745-91d1e6c284e7', '473ff782-79ac-45a6-99a0-2400e2b3868d', '7758a786-b50d-43ae-8797-340155bf3f5a'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:17:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:17:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:17:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:25 devstack sudo[103836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:17:25 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:26 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42cb596e-9f13-411f-ac0d-e61010c8111c_kqcwdefr" returned: 1 in 0.473s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42cb596e-9f13-411f-ac0d-e61010c8111c_kqcwdefr' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1b0b6d-88b7-407e-be08-84fc0872b6f4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42cb596e-9f13-411f-ac0d-e61010c8111c_yr59jyoedevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:26 devstack sudo[103840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42cb596e-9f13-411f-ac0d-e61010c8111c_yr59jyoedevstack@QuobyteHD
Sep 25 15:17:26 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:26 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.620s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:17:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Deleted volume successfully.
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b33d59f5-a576-463c-b43b-a872d3082c8c tempest-ProjectReaderTests-265796023 None] Lock "cinder-840af75c-90f4-44be-bc79-8ea8348c18e4-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:17:26 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42cb596e-9f13-411f-ac0d-e61010c8111c_yr59jyoedevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] 42cb596e-9f13-411f-ac0d-e61010c8111c was qcow2, converting to qcow2 {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_42cb596e-9f13-411f-ac0d-e61010c8111c_yr59jyoedevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:26 devstack sudo[103848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_42cb596e-9f13-411f-ac0d-e61010c8111c_yr59jyoedevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739
Sep 25 15:17:26 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Flow 'volume_create_manager' (995eb7d6-fbb9-4ee0-a402-1b25f8825637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c47819-8db2-4406-8697-0c84f5651d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c47819-8db2-4406-8697-0c84f5651d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-361629740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59048121-0c72-44de-9aaa-cbb82dc72af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d030e1d45393419589cfc2f59137daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:17:27Z,use_quota=True,user_id='451425098f404425adc9c1f0ce1a010e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40aa1f23-05c9-4d96-9216-96dc77bc6d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40aa1f23-05c9-4d96-9216-96dc77bc6d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb0ebf41-ea86-4af7-9137-54fbd335f9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb0ebf41-ea86-4af7-9137-54fbd335f9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59048121-0c72-44de-9aaa-cbb82dc72af5', 'volume_name': 'volume-59048121-0c72-44de-9aaa-cbb82dc72af5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf01032-5428-4e18-91c7-196f8ecd0512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf01032-5428-4e18-91c7-196f8ecd0512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a15bcde-686b-4439-80bf-0fce32da2102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:26 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Volume 59048121-0c72-44de-9aaa-cbb82dc72af5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59048121-0c72-44de-9aaa-cbb82dc72af5', 'volume_size': 1}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-361629740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59048121-0c72-44de-9aaa-cbb82dc72af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d030e1d45393419589cfc2f59137daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:17:27Z,use_quota=True,user_id='451425098f404425adc9c1f0ce1a010e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Creating volume 59048121-0c72-44de-9aaa-cbb82dc72af5 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:17:26 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:17:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-59048121-0c72-44de-9aaa-cbb82dc72af5 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:27 devstack sudo[103854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-59048121-0c72-44de-9aaa-cbb82dc72af5 1073741824
Sep 25 15:17:27 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:27 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-59048121-0c72-44de-9aaa-cbb82dc72af5 1073741824" returned: 0 in 0.623s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-59048121-0c72-44de-9aaa-cbb82dc72af5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:27 devstack sudo[103871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-59048121-0c72-44de-9aaa-cbb82dc72af5
Sep 25 15:17:27 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:28 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-59048121-0c72-44de-9aaa-cbb82dc72af5" returned: 0 in 0.445s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:17:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a15bcde-686b-4439-80bf-0fce32da2102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59048121-0c72-44de-9aaa-cbb82dc72af5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67277ef5-d9d0-47bd-8acb-fafcf1e8dfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:28 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Volume volume-59048121-0c72-44de-9aaa-cbb82dc72af5 (59048121-0c72-44de-9aaa-cbb82dc72af5): created successfully
Sep 25 15:17:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67277ef5-d9d0-47bd-8acb-fafcf1e8dfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Flow 'volume_create_manager' (995eb7d6-fbb9-4ee0-a402-1b25f8825637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:17:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fffcb18d-6519-44c3-a3b7-0c7ab5606425 tempest-ProjectReaderTests-265796023 None] Created volume successfully.
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Acquiring lock "cinder-59048121-0c72-44de-9aaa-cbb82dc72af5-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Lock "cinder-59048121-0c72-44de-9aaa-cbb82dc72af5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Acquiring lock "cinder-quobyte-59048121-0c72-44de-9aaa-cbb82dc72af5" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Lock "cinder-quobyte-59048121-0c72-44de-9aaa-cbb82dc72af5" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[865760d3-f8d1-4a85-9133-099e28e5d7f6]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-59048121-0c72-44de-9aaa-cbb82dc72af5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:29 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_42cb596e-9f13-411f-ac0d-e61010c8111c_yr59jyoedevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739" returned: 0 in 2.446s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_42cb596e-9f13-411f-ac0d-e61010c8111c_yr59jyoedevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:17:29 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Converted 112.00 MB image at 45.76 MB/s
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:29 devstack sudo[103877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739 1G
Sep 25 15:17:29 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:29 devstack sudo[103876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-59048121-0c72-44de-9aaa-cbb82dc72af5
Sep 25 15:17:29 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:29 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739 1G" returned: 0 in 0.427s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Downloaded image 42cb596e-9f13-411f-ac0d-e61010c8111c ((None, [{'url': 'file:///opt/stack/data/glance/images/42cb596e-9f13-411f-ac0d-e61010c8111c', 'metadata': {}}])) to volume 06b99253-d698-4029-a7ea-0d56d56b2739 successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Temporary image 42cb596e-9f13-411f-ac0d-e61010c8111c for user fa63b79aa2934835bce654d0ae54c0e5 is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Marking volume 06b99253-d698-4029-a7ea-0d56d56b2739 as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Copying metadata from image 42cb596e-9f13-411f-ac0d-e61010c8111c to 06b99253-d698-4029-a7ea-0d56d56b2739. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Creating volume glance metadata for volume 06b99253-d698-4029-a7ea-0d56d56b2739 backed by image 42cb596e-9f13-411f-ac0d-e61010c8111c with: {'image_id': '42cb596e-9f13-411f-ac0d-e61010c8111c', 'image_name': 'tempest-scenario-img--1226323854', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 15:17:29 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-59048121-0c72-44de-9aaa-cbb82dc72af5" returned: 0 in 0.562s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-59048121-0c72-44de-9aaa-cbb82dc72af5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:29 devstack sudo[103886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-59048121-0c72-44de-9aaa-cbb82dc72af5
Sep 25 15:17:29 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97f2285-a2a3-4d1d-aad8-fd08dac27908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b99253-d698-4029-a7ea-0d56d56b2739', 'volume_size': 1, 'image_id': '42cb596e-9f13-411f-ac0d-e61010c8111c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42cb596e-9f13-411f-ac0d-e61010c8111c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1226323854', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c362d9df1b7e4ad5988a846cb33bc5dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '42cb596e-9f13-411f-ac0d-e61010c8111c', 'created_at': datetime.datetime(2026, 9, 25, 13, 17, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 17, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42cb596e-9f13-411f-ac0d-e61010c8111c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7638263d13d0>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03a858d-d767-4791-8982-19edf244118b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:29 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Volume volume-06b99253-d698-4029-a7ea-0d56d56b2739 (06b99253-d698-4029-a7ea-0d56d56b2739): created successfully
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03a858d-d767-4791-8982-19edf244118b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Flow 'volume_create_manager' (1d8ef55c-f993-479c-99f2-532b42c40b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:17:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c393ddb7-54d1-4895-8435-50b7837ba991 tempest-TestInstancesWithCinderVolumes-314416230 None] Created volume successfully.
Sep 25 15:17:30 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-59048121-0c72-44de-9aaa-cbb82dc72af5" returned: 0 in 0.318s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Lock "cinder-quobyte-59048121-0c72-44de-9aaa-cbb82dc72af5" released by "delete_volume" :: held 0.937s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:17:30 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Created reservations ['9c6da1c8-e90f-45a3-a430-104617c0fbda', '13d630f0-bbcb-4387-b7c6-b793cb615025', 'cbce9eb2-15dd-4620-920e-01c3d32f265c', '66ee29e6-31a1-4085-bcc1-ead79d98c39f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:17:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:17:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:17:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:30 devstack sudo[103889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:17:30 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:30 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.419s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:30 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:17:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Deleted volume successfully.
Sep 25 15:17:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8007cedc-19a3-478f-aa58-97b0d6c4080a tempest-ProjectReaderTests-265796023 None] Lock "cinder-59048121-0c72-44de-9aaa-cbb82dc72af5-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:17:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-ba702b17-f5ab-4703-b2dd-9235c372f02e req-f69870c0-53e1-43fe-8253-82415fee7275 tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-ba702b17-f5ab-4703-b2dd-9235c372f02e req-f69870c0-53e1-43fe-8253-82415fee7275 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-ba702b17-f5ab-4703-b2dd-9235c372f02e req-f69870c0-53e1-43fe-8253-82415fee7275 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-ba702b17-f5ab-4703-b2dd-9235c372f02e req-f69870c0-53e1-43fe-8253-82415fee7275 tempest-TestInstancesWithCinderVolumes-314416230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-06b99253-d698-4029-a7ea-0d56d56b2739', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f19c352f-70de-428d-9062-6e6f448c97e7', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:17:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-ba702b17-f5ab-4703-b2dd-9235c372f02e req-f69870c0-53e1-43fe-8253-82415fee7275 tempest-TestInstancesWithCinderVolumes-314416230 None] attachment_update completed successfully.
Sep 25 15:17:44 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=87,cinder:UPDATE=107,cinder:INSERT=34,cinder:DELETE=12 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:17:44 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=116,cinder:SELECT=76,cinder:DELETE=9,cinder:INSERT=23 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Flow 'volume_create_manager' (d6074d15-c181-41e6-9ee0-aaa58ed5ea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acd3ec5b-d399-45fa-b89c-5d7f73b845b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acd3ec5b-d399-45fa-b89c-5d7f73b845b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-513266057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1065c3a6-22e4-443e-b5a3-739c50ac6291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='388f1f575b2446bc8b3e317f2472e84b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:17:46Z,use_quota=True,user_id='4b48a67f0a174ef3a76c096b59171ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68b4127-40dc-471d-a6f8-1b00441c5ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68b4127-40dc-471d-a6f8-1b00441c5ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c3d675-4fe3-420d-92bf-b7a3165232bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c3d675-4fe3-420d-92bf-b7a3165232bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1065c3a6-22e4-443e-b5a3-739c50ac6291', 'volume_name': 'volume-1065c3a6-22e4-443e-b5a3-739c50ac6291', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8a69b2-c9d2-4bd8-af04-898652ab6bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8a69b2-c9d2-4bd8-af04-898652ab6bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c7006a-a8fa-4ae4-952c-258ccbe56817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:46 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Volume 1065c3a6-22e4-443e-b5a3-739c50ac6291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1065c3a6-22e4-443e-b5a3-739c50ac6291', 'volume_size': 1}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-513266057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1065c3a6-22e4-443e-b5a3-739c50ac6291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='388f1f575b2446bc8b3e317f2472e84b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:17:46Z,use_quota=True,user_id='4b48a67f0a174ef3a76c096b59171ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Creating volume 1065c3a6-22e4-443e-b5a3-739c50ac6291 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:17:46 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:17:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1065c3a6-22e4-443e-b5a3-739c50ac6291 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:46 devstack sudo[104421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1065c3a6-22e4-443e-b5a3-739c50ac6291 1073741824
Sep 25 15:17:46 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:47 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1065c3a6-22e4-443e-b5a3-739c50ac6291 1073741824" returned: 0 in 0.536s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1065c3a6-22e4-443e-b5a3-739c50ac6291 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:47 devstack sudo[104427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1065c3a6-22e4-443e-b5a3-739c50ac6291
Sep 25 15:17:47 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:47 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1065c3a6-22e4-443e-b5a3-739c50ac6291" returned: 0 in 0.405s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:17:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c7006a-a8fa-4ae4-952c-258ccbe56817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1065c3a6-22e4-443e-b5a3-739c50ac6291', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edcfc642-b0d0-47ab-bf2c-522de2a201bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:17:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Volume volume-1065c3a6-22e4-443e-b5a3-739c50ac6291 (1065c3a6-22e4-443e-b5a3-739c50ac6291): created successfully
Sep 25 15:17:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edcfc642-b0d0-47ab-bf2c-522de2a201bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:17:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Flow 'volume_create_manager' (d6074d15-c181-41e6-9ee0-aaa58ed5ea90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:17:47 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4aeb7171-65c9-4af5-8173-8709645e2425 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Created volume successfully.
Sep 25 15:17:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-95eb6272-be89-4e79-a78a-a04813856be7 req-4fa91a0c-9037-4587-85fc-dfd1d06a5556 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-95eb6272-be89-4e79-a78a-a04813856be7 req-4fa91a0c-9037-4587-85fc-dfd1d06a5556 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-95eb6272-be89-4e79-a78a-a04813856be7 req-4fa91a0c-9037-4587-85fc-dfd1d06a5556 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-95eb6272-be89-4e79-a78a-a04813856be7 req-4fa91a0c-9037-4587-85fc-dfd1d06a5556 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-1065c3a6-22e4-443e-b5a3-739c50ac6291', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bca23f83-29df-4ec1-b8ac-963c8ec8236b', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:17:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-95eb6272-be89-4e79-a78a-a04813856be7 req-4fa91a0c-9037-4587-85fc-dfd1d06a5556 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] attachment_update completed successfully.
Sep 25 15:17:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-5ed252a1-1fbc-4f1d-8d5e-845fa59c85c3 req-43a43ff3-924b-46c8-97ec-207ff6954168 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Terminate volume connection completed successfully.
Sep 25 15:17:53 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-5ed252a1-1fbc-4f1d-8d5e-845fa59c85c3 req-43a43ff3-924b-46c8-97ec-207ff6954168 tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Deleting attachment bca23f83-29df-4ec1-b8ac-963c8ec8236b. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:17:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Acquiring lock "cinder-1065c3a6-22e4-443e-b5a3-739c50ac6291-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:17:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Lock "cinder-1065c3a6-22e4-443e-b5a3-739c50ac6291-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:17:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Acquiring lock "cinder-quobyte-1065c3a6-22e4-443e-b5a3-739c50ac6291" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:17:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Lock "cinder-quobyte-1065c3a6-22e4-443e-b5a3-739c50ac6291" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:17:54 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[36881abf-45fa-4efe-baf1-366db2bb4bbd]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:17:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1065c3a6-22e4-443e-b5a3-739c50ac6291 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:54 devstack sudo[104458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1065c3a6-22e4-443e-b5a3-739c50ac6291
Sep 25 15:17:54 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:55 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1065c3a6-22e4-443e-b5a3-739c50ac6291" returned: 0 in 0.447s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1065c3a6-22e4-443e-b5a3-739c50ac6291 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:55 devstack sudo[104463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1065c3a6-22e4-443e-b5a3-739c50ac6291
Sep 25 15:17:55 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:55 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1065c3a6-22e4-443e-b5a3-739c50ac6291" returned: 0 in 0.301s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Lock "cinder-quobyte-1065c3a6-22e4-443e-b5a3-739c50ac6291" released by "delete_volume" :: held 0.808s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:17:55 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Created reservations ['1fba45bb-99be-4a08-85b8-3c064bb6a225', 'c07ee498-c929-4cd5-a1c0-5e713e80ab70', '4a331bde-a618-4f53-8182-69e3bb8a154a', '9b5295db-bfe7-4335-9198-6ef77fe06c69'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:17:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:17:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:17:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:17:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:17:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:17:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:17:55 devstack sudo[104472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:17:55 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:17:55 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root
Sep 25 15:17:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.334s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:17:55 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:17:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Deleted volume successfully.
Sep 25 15:17:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6e6fe1b2-70e1-44c4-8966-a808d5b5f50b tempest-TestServerVolumeAttachScenarioOldVersion-1057551594 None] Lock "cinder-1065c3a6-22e4-443e-b5a3-739c50ac6291-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:18:05 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=15,cinder:INSERT=2,cinder:UPDATE=13 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:18:05 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:18:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-e8479bd6-5ae0-4853-9294-f2fbdda56ee4 req-a3dd228b-f266-4d87-a39d-0b5e53e3e4a9 tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:18:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-e8479bd6-5ae0-4853-9294-f2fbdda56ee4 req-a3dd228b-f266-4d87-a39d-0b5e53e3e4a9 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:18:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-e8479bd6-5ae0-4853-9294-f2fbdda56ee4 req-a3dd228b-f266-4d87-a39d-0b5e53e3e4a9 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:18:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-e8479bd6-5ae0-4853-9294-f2fbdda56ee4 req-a3dd228b-f266-4d87-a39d-0b5e53e3e4a9 tempest-TestInstancesWithCinderVolumes-314416230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e31fa1c-eb54-4e08-bc49-57ac69b01b34', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:18:13 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-e8479bd6-5ae0-4853-9294-f2fbdda56ee4 req-a3dd228b-f266-4d87-a39d-0b5e53e3e4a9 tempest-TestInstancesWithCinderVolumes-314416230 None] attachment_update completed successfully.
Sep 25 15:18:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-c4ba12e4-bcfa-4963-a9a7-e01303e47c09 req-5582c9d2-929e-425d-8c75-e9edb8010c4f tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:18:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-c4ba12e4-bcfa-4963-a9a7-e01303e47c09 req-5582c9d2-929e-425d-8c75-e9edb8010c4f tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:18:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-c4ba12e4-bcfa-4963-a9a7-e01303e47c09 req-5582c9d2-929e-425d-8c75-e9edb8010c4f tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:18:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-c4ba12e4-bcfa-4963-a9a7-e01303e47c09 req-5582c9d2-929e-425d-8c75-e9edb8010c4f tempest-TestInstancesWithCinderVolumes-314416230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6bb8257-94c9-4565-aae3-db32882e548c', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:18:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-c4ba12e4-bcfa-4963-a9a7-e01303e47c09 req-5582c9d2-929e-425d-8c75-e9edb8010c4f tempest-TestInstancesWithCinderVolumes-314416230 None] attachment_update completed successfully.
Sep 25 15:18:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:18:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:18:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:18:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:18:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:18:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:18:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:20 devstack sudo[104642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:18:20 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:21 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.397s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:18:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:18:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 29 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:18:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>, <Thread(Rabbit-heartbeat, started daemon 129983531771584)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:18:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-4dd68aed-4693-49e4-bd96-c5b99eaae1e6 req-09ab248a-ccb3-47fa-a72c-51cccb8f37f9 tempest-TestInstancesWithCinderVolumes-314416230 None] Terminate volume connection completed successfully.
Sep 25 15:18:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-4dd68aed-4693-49e4-bd96-c5b99eaae1e6 req-09ab248a-ccb3-47fa-a72c-51cccb8f37f9 tempest-TestInstancesWithCinderVolumes-314416230 None] Deleting attachment 2e31fa1c-eb54-4e08-bc49-57ac69b01b34. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:18:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "cinder-a9be4b27-f39c-49fa-b2b7-134f76dfd910-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:18:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "cinder-a9be4b27-f39c-49fa-b2b7-134f76dfd910-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:18:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "cinder-quobyte-a9be4b27-f39c-49fa-b2b7-134f76dfd910" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:18:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "cinder-quobyte-a9be4b27-f39c-49fa-b2b7-134f76dfd910" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:18:25 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5aedeb-5549-4803-8308-f5a51005e3a0]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:18:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:25 devstack sudo[104676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910
Sep 25 15:18:25 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:26 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910" returned: 0 in 0.592s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:26 devstack sudo[104681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910
Sep 25 15:18:26 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:26 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a9be4b27-f39c-49fa-b2b7-134f76dfd910" returned: 0 in 0.529s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "cinder-quobyte-a9be4b27-f39c-49fa-b2b7-134f76dfd910" released by "delete_volume" :: held 1.192s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:18:26 devstack cinder-volume[87071]: WARNING cinder.quota [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115041582-764802282 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115041582-764802282, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:18:26 devstack cinder-volume[87071]: WARNING cinder.quota [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115041582-764802282 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115041582-764802282, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:18:26 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Created reservations ['419f2e05-a066-40b1-af3c-4b970b0f978c', '5ea57daa-7096-481d-8869-833c0c8cb1d9', 'bacbe96d-ebe2-4b7f-82e6-8b0db79699b6', '2e303630-51ff-4022-b6ed-a2538d30f933'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:18:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:18:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:18:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:18:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:18:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:18:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:26 devstack sudo[104684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:18:26 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:27 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.510s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:27 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:18:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Deleted volume successfully.
Sep 25 15:18:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-619c4521-223f-4d67-8bc5-3361321275f2 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "cinder-a9be4b27-f39c-49fa-b2b7-134f76dfd910-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:18:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-33c34b9d-ae95-4560-b379-e4df29067a04 req-dedac094-78f3-4f8f-a616-33e0fe12a8f4 tempest-TestInstancesWithCinderVolumes-314416230 None] Terminate volume connection completed successfully.
Sep 25 15:18:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-33c34b9d-ae95-4560-b379-e4df29067a04 req-dedac094-78f3-4f8f-a616-33e0fe12a8f4 tempest-TestInstancesWithCinderVolumes-314416230 None] Deleting attachment c6bb8257-94c9-4565-aae3-db32882e548c. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:18:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "cinder-b2950305-b0f7-4fc0-9a40-bd496f5f78dc-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:18:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "cinder-b2950305-b0f7-4fc0-9a40-bd496f5f78dc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:18:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "cinder-quobyte-b2950305-b0f7-4fc0-9a40-bd496f5f78dc" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:18:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "cinder-quobyte-b2950305-b0f7-4fc0-9a40-bd496f5f78dc" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:18:31 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[faced4f7-4ace-4a2f-8fd8-cdac37f3d285]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:18:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:31 devstack sudo[104718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc
Sep 25 15:18:31 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:32 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc" returned: 0 in 0.492s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:32 devstack sudo[104723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc
Sep 25 15:18:32 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:32 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b2950305-b0f7-4fc0-9a40-bd496f5f78dc" returned: 0 in 0.341s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "cinder-quobyte-b2950305-b0f7-4fc0-9a40-bd496f5f78dc" released by "delete_volume" :: held 0.891s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:18:32 devstack cinder-volume[87071]: WARNING cinder.quota [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1937805881-1266623704 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1937805881-1266623704, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:18:32 devstack cinder-volume[87071]: WARNING cinder.quota [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1937805881-1266623704 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1937805881-1266623704, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:18:32 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Created reservations ['102bb31e-20f1-48fd-9733-f3a5484fd38d', '84ac18ca-7377-4fcf-bea4-456bfb87fb5f', 'f3dada17-7f50-4796-91a2-65dfda1078c9', '0d218aa8-fc89-4e74-9b86-c62e39915ae5'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:18:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:18:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:18:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:18:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:18:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:18:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:32 devstack sudo[104726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:18:32 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:33 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.341s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:33 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:18:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Deleted volume successfully.
Sep 25 15:18:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-20cf0c80-e56b-4599-8d10-d96bc6198b31 tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "cinder-b2950305-b0f7-4fc0-9a40-bd496f5f78dc-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:18:38 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-1f645b51-d970-4de8-bb07-c3556e84568e req-e2dca413-c010-464b-9a8e-92035d8cf8d6 tempest-TestInstancesWithCinderVolumes-314416230 None] Terminate volume connection completed successfully.
Sep 25 15:18:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-1f645b51-d970-4de8-bb07-c3556e84568e req-e2dca413-c010-464b-9a8e-92035d8cf8d6 tempest-TestInstancesWithCinderVolumes-314416230 None] Deleting attachment f19c352f-70de-428d-9062-6e6f448c97e7. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:18:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "cinder-06b99253-d698-4029-a7ea-0d56d56b2739-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:18:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "cinder-06b99253-d698-4029-a7ea-0d56d56b2739-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:18:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "cinder-quobyte-06b99253-d698-4029-a7ea-0d56d56b2739" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:18:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "cinder-quobyte-06b99253-d698-4029-a7ea-0d56d56b2739" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:18:40 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c680fa14-b5fc-4076-b5f9-6a161c9fc399]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:18:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:40 devstack sudo[104758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739
Sep 25 15:18:40 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:40 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739" returned: 0 in 0.530s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:40 devstack sudo[104763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739
Sep 25 15:18:40 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:40 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-06b99253-d698-4029-a7ea-0d56d56b2739" returned: 0 in 0.325s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "cinder-quobyte-06b99253-d698-4029-a7ea-0d56d56b2739" released by "delete_volume" :: held 0.926s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:18:41 devstack cinder-volume[87071]: WARNING cinder.quota [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2080873090-1121417220 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2080873090-1121417220, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:18:41 devstack cinder-volume[87071]: WARNING cinder.quota [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2080873090-1121417220 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2080873090-1121417220, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:18:41 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Created reservations ['739dd700-2a14-4c1f-9b2c-ac4aadb0f3eb', '7655dc70-0dfd-4d49-9f34-0e1a31f9d15a', '063283f3-0e41-4c13-a37a-208e2e9b010d', 'e9e7287a-f279-4de3-8e68-13c631a140fd'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:18:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:18:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:18:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:18:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:18:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:18:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:41 devstack sudo[104766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:18:41 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:41 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.367s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:41 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:18:41 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Deleted volume successfully.
Sep 25 15:18:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c91a824a-495f-4ade-9381-7a50220d85bf tempest-TestInstancesWithCinderVolumes-314416230 None] Lock "cinder-06b99253-d698-4029-a7ea-0d56d56b2739-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:18:45 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:18:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Flow 'volume_create_manager' (d34e07d0-3ebc-4c47-8ce0-80dd50ea6094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:18:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3c235a-455a-4739-900d-844fda407cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:18:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3c235a-455a-4739-900d-844fda407cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-67369422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7735623f-a435-419a-b1ed-29f3b8661529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51e9ad038afc44f282227a78948b7d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:18:45Z,use_quota=True,user_id='503aeb050d60497b8d114518f29d964f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:18:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92eb793e-a9dd-43bb-91eb-20b661dcadb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:18:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92eb793e-a9dd-43bb-91eb-20b661dcadb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:18:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4cab21-d207-49dd-9e46-44c245bb2410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:18:45 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 15:18:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4cab21-d207-49dd-9e46-44c245bb2410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7735623f-a435-419a-b1ed-29f3b8661529', 'volume_name': 'volume-7735623f-a435-419a-b1ed-29f3b8661529', 'volume_size': 1, 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd97dcba93bf843d9acf4a870a4730210', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'created_at': datetime.datetime(2026, 9, 25, 12, 52, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 52, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a354fa4c-98b3-48a7-8483-e976ebf152bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x763825b57c80>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:18:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (affea130-4c3d-4c43-83c7-2cf087be9d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:18:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (affea130-4c3d-4c43-83c7-2cf087be9d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:18:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb47ea0c-766f-41f2-9753-16f320db7ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:18:46 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Volume 7735623f-a435-419a-b1ed-29f3b8661529: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7735623f-a435-419a-b1ed-29f3b8661529', 'volume_size': 1, 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd97dcba93bf843d9acf4a870a4730210', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'created_at': datetime.datetime(2026, 9, 25, 12, 52, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 52, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a354fa4c-98b3-48a7-8483-e976ebf152bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x763825b57c80>}
Sep 25 15:18:46 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Trying to clone 7735623f-a435-419a-b1ed-29f3b8661529 from image a354fa4c-98b3-48a7-8483-e976ebf152bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 15:18:46 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_du8qzecddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 15:18:46 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 15:18:46 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af7f870-e693-4f82-9c2e-9155d66598e6]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:18:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_du8qzecddevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:46 devstack sudo[104771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_du8qzecddevstack@QuobyteHD
Sep 25 15:18:46 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:46 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_du8qzecddevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:46 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Temporary image a354fa4c-98b3-48a7-8483-e976ebf152bc is fetched for user 503aeb050d60497b8d114518f29d964f. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 15:18:46 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a5029e-ed1b-4648-a73c-21d0e37a0e26]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:18:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_du8qzecddevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:47 devstack sudo[104776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_du8qzecddevstack@QuobyteHD
Sep 25 15:18:47 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:47 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_du8qzecddevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:18:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:18:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-67369422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7735623f-a435-419a-b1ed-29f3b8661529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51e9ad038afc44f282227a78948b7d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:18:45Z,use_quota=True,user_id='503aeb050d60497b8d114518f29d964f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:18:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Creating volume 7735623f-a435-419a-b1ed-29f3b8661529 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:18:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:18:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:18:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:18:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:18:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:18:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:18:47 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:18:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:47 devstack sudo[104781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529 1073741824
Sep 25 15:18:47 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:47 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529 1073741824" returned: 0 in 0.484s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:47 devstack sudo[104787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529
Sep 25 15:18:47 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:48 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529" returned: 0 in 0.288s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:18:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:18:48 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Attempting download of a354fa4c-98b3-48a7-8483-e976ebf152bc ((None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}])) to volume 7735623f-a435-419a-b1ed-29f3b8661529. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 15:18:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b614bc61-79db-4359-b67f-8ae1a19ef354]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:18:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_uql67le3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:48 devstack sudo[104790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_uql67le3
Sep 25 15:18:48 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:48 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_uql67le3" returned: 0 in 0.503s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_uql67le3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:48 devstack sudo[104794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_uql67le3
Sep 25 15:18:48 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:49 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_uql67le3" returned: 1 in 0.433s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a354fa4c-98b3-48a7-8483-e976ebf152bc_uql67le3' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:18:49 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0799075-35c2-4655-bf85-cc8f745d10d0]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:18:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_du8qzecddevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:49 devstack sudo[104798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_du8qzecddevstack@QuobyteHD
Sep 25 15:18:49 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:49 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_du8qzecddevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:49 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] a354fa4c-98b3-48a7-8483-e976ebf152bc was qcow2, converting to qcow2 {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 15:18:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_du8qzecddevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:49 devstack sudo[104804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_du8qzecddevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529
Sep 25 15:18:49 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:52 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_du8qzecddevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529" returned: 0 in 2.409s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:52 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a354fa4c-98b3-48a7-8483-e976ebf152bc_du8qzecddevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:18:52 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Converted 112.00 MB image at 46.46 MB/s
Sep 25 15:18:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:18:52 devstack sudo[104819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529 1G
Sep 25 15:18:52 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:18:52 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root
Sep 25 15:18:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529 1G" returned: 0 in 0.404s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:18:52 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Downloaded image a354fa4c-98b3-48a7-8483-e976ebf152bc ((None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}])) to volume 7735623f-a435-419a-b1ed-29f3b8661529 successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 15:18:52 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Temporary image a354fa4c-98b3-48a7-8483-e976ebf152bc for user 503aeb050d60497b8d114518f29d964f is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 15:18:52 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Marking volume 7735623f-a435-419a-b1ed-29f3b8661529 as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 15:18:52 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Copying metadata from image a354fa4c-98b3-48a7-8483-e976ebf152bc to 7735623f-a435-419a-b1ed-29f3b8661529. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 15:18:52 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Creating volume glance metadata for volume 7735623f-a435-419a-b1ed-29f3b8661529 backed by image a354fa4c-98b3-48a7-8483-e976ebf152bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 15:18:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb47ea0c-766f-41f2-9753-16f320db7ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7735623f-a435-419a-b1ed-29f3b8661529', 'volume_size': 1, 'image_id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a354fa4c-98b3-48a7-8483-e976ebf152bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd97dcba93bf843d9acf4a870a4730210', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a354fa4c-98b3-48a7-8483-e976ebf152bc', 'created_at': datetime.datetime(2026, 9, 25, 12, 52, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 12, 52, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a354fa4c-98b3-48a7-8483-e976ebf152bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x763825b57c80>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:18:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873d2354-b00c-425d-90d6-005b461745c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:18:52 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Volume volume-7735623f-a435-419a-b1ed-29f3b8661529 (7735623f-a435-419a-b1ed-29f3b8661529): created successfully
Sep 25 15:18:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873d2354-b00c-425d-90d6-005b461745c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:18:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Flow 'volume_create_manager' (d34e07d0-3ebc-4c47-8ce0-80dd50ea6094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:18:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e70f8b32-b779-4519-bdbd-287267feed75 tempest-TestShelveInstance-2137677980 None] Created volume successfully.
Sep 25 15:18:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-2253b15b-b60e-4c45-bac6-ae531df22bdc req-fa5b7311-790e-4895-bc06-c55f5739ea3e tempest-TestShelveInstance-2137677980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:18:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-2253b15b-b60e-4c45-bac6-ae531df22bdc req-fa5b7311-790e-4895-bc06-c55f5739ea3e tempest-TestShelveInstance-2137677980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:18:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-2253b15b-b60e-4c45-bac6-ae531df22bdc req-fa5b7311-790e-4895-bc06-c55f5739ea3e tempest-TestShelveInstance-2137677980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:18:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-2253b15b-b60e-4c45-bac6-ae531df22bdc req-fa5b7311-790e-4895-bc06-c55f5739ea3e tempest-TestShelveInstance-2137677980 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-7735623f-a435-419a-b1ed-29f3b8661529', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b54f65af-4105-4fa6-a680-336a5543a9be', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:18:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-2253b15b-b60e-4c45-bac6-ae531df22bdc req-fa5b7311-790e-4895-bc06-c55f5739ea3e tempest-TestShelveInstance-2137677980 None] attachment_update completed successfully.
Sep 25 15:19:03 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:19:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Flow 'volume_create_manager' (696d0045-15d1-4354-a1a8-682837dd1b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e766d78-1bbe-4fe8-beca-c83537fd102d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e766d78-1bbe-4fe8-beca-c83537fd102d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11dfbd44-a70f-42ac-8a2c-25cb42c499a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91af0e01e98546d2a58a626fd270309d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:04Z,use_quota=True,user_id='2a5f8059fd7240eb9877dedd6f9e2425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f149b27-b126-4c65-a986-2d30262a600d),volume_type_id=2f149b27-b126-4c65-a986-2d30262a600d)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea90ebe-052d-4147-aaf2-12138394ed46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea90ebe-052d-4147-aaf2-12138394ed46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1b37a2-1ab8-4640-9f4e-050b57ebb61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:03 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 15:19:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1b37a2-1ab8-4640-9f4e-050b57ebb61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '11dfbd44-a70f-42ac-8a2c-25cb42c499a1', 'volume_name': 'volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1', 'volume_size': 1, 'image_id': '879c41fa-33b0-4f02-add8-d6776b6162b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/879c41fa-33b0-4f02-add8-d6776b6162b6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '057e4d6ab581990b59208e4eeda35daa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '91af0e01e98546d2a58a626fd270309d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c92224852c391d370e1286073bfd99c369da81f644698d6fbd6d03736a8fade50997bde30de40dc84d14cddaeec2d478437bfd6337868d038129ede0c931cd73', 'id': '879c41fa-33b0-4f02-add8-d6776b6162b6', 'created_at': datetime.datetime(2026, 9, 25, 13, 19, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 19, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/879c41fa-33b0-4f02-add8-d6776b6162b6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76381b9aaff0>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a6f7d3-66ca-4595-a7b9-f7761bb3db45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a6f7d3-66ca-4595-a7b9-f7761bb3db45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f5f7c0-e60e-4cc9-8605-fd02ce265e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:03 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Volume 11dfbd44-a70f-42ac-8a2c-25cb42c499a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1', 'volume_size': 1, 'image_id': '879c41fa-33b0-4f02-add8-d6776b6162b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/879c41fa-33b0-4f02-add8-d6776b6162b6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '057e4d6ab581990b59208e4eeda35daa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '91af0e01e98546d2a58a626fd270309d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c92224852c391d370e1286073bfd99c369da81f644698d6fbd6d03736a8fade50997bde30de40dc84d14cddaeec2d478437bfd6337868d038129ede0c931cd73', 'id': '879c41fa-33b0-4f02-add8-d6776b6162b6', 'created_at': datetime.datetime(2026, 9, 25, 13, 19, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 19, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/879c41fa-33b0-4f02-add8-d6776b6162b6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76381b9aaff0>}
Sep 25 15:19:03 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Trying to clone 11dfbd44-a70f-42ac-8a2c-25cb42c499a1 from image 879c41fa-33b0-4f02-add8-d6776b6162b6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/879c41fa-33b0-4f02-add8-d6776b6162b6', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 15:19:04 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 15:19:04 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 15:19:04 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[efecb6ca-3734-4a8c-8d45-289d09ebdf74]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:04 devstack sudo[105337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD
Sep 25 15:19:04 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:04 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:04 devstack sudo[105341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD
Sep 25 15:19:04 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:04 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD" returned: 1 in 0.365s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:19:04 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Temporary image 879c41fa-33b0-4f02-add8-d6776b6162b6 is fetched for user 2a5f8059fd7240eb9877dedd6f9e2425. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b188b5d3-e93d-44c3-b262-919002609b37]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:05 devstack sudo[105346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD
Sep 25 15:19:05 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:05 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:05 devstack sudo[105350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD
Sep 25 15:19:05 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:05 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD" returned: 1 in 0.405s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11dfbd44-a70f-42ac-8a2c-25cb42c499a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91af0e01e98546d2a58a626fd270309d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:04Z,use_quota=True,user_id='2a5f8059fd7240eb9877dedd6f9e2425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f149b27-b126-4c65-a986-2d30262a600d),volume_type_id=2f149b27-b126-4c65-a986-2d30262a600d)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Creating volume 11dfbd44-a70f-42ac-8a2c-25cb42c499a1 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:19:05 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:19:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:05 devstack sudo[105355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1 1073741824
Sep 25 15:19:05 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:06 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1 1073741824" returned: 0 in 0.597s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:06 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=49,cinder:UPDATE=36,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:19:06 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=50,cinder:UPDATE=32,cinder:INSERT=17,cinder:DELETE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:19:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:06 devstack sudo[105362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1
Sep 25 15:19:06 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:06 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1" returned: 0 in 0.324s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:19:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:06 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Attempting download of 879c41fa-33b0-4f02-add8-d6776b6162b6 ((None, [{'url': 'file:///opt/stack/data/glance/images/879c41fa-33b0-4f02-add8-d6776b6162b6', 'metadata': {}}])) to volume 11dfbd44-a70f-42ac-8a2c-25cb42c499a1. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 15:19:06 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c2f859-88a1-4b97-a35f-f6209c3a903f]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_879c41fa-33b0-4f02-add8-d6776b6162b6_ph9ojre9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:07 devstack sudo[105366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_879c41fa-33b0-4f02-add8-d6776b6162b6_ph9ojre9
Sep 25 15:19:07 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:07 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_879c41fa-33b0-4f02-add8-d6776b6162b6_ph9ojre9" returned: 0 in 0.373s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_879c41fa-33b0-4f02-add8-d6776b6162b6_ph9ojre9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:07 devstack sudo[105371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_879c41fa-33b0-4f02-add8-d6776b6162b6_ph9ojre9
Sep 25 15:19:07 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:07 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_879c41fa-33b0-4f02-add8-d6776b6162b6_ph9ojre9" returned: 1 in 0.397s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_879c41fa-33b0-4f02-add8-d6776b6162b6_ph9ojre9' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:19:07 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[266ccc20-0d55-41d3-9612-38a0e0e739d3]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:07 devstack sudo[105375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD
Sep 25 15:19:07 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:08 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:08 devstack sudo[105380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD
Sep 25 15:19:08 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:08 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:19:08 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] 879c41fa-33b0-4f02-add8-d6776b6162b6 was raw, converting to qcow2 {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 15:19:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:08 devstack sudo[105385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1
Sep 25 15:19:08 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:09 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1" returned: 0 in 0.587s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:09 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_879c41fa-33b0-4f02-add8-d6776b6162b6_06_856podevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:19:09 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 15:19:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:09 devstack sudo[105391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1 1G
Sep 25 15:19:09 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:09 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1 1G" returned: 0 in 0.362s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:09 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Downloaded image 879c41fa-33b0-4f02-add8-d6776b6162b6 ((None, [{'url': 'file:///opt/stack/data/glance/images/879c41fa-33b0-4f02-add8-d6776b6162b6', 'metadata': {}}])) to volume 11dfbd44-a70f-42ac-8a2c-25cb42c499a1 successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 15:19:09 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Temporary image 879c41fa-33b0-4f02-add8-d6776b6162b6 for user 2a5f8059fd7240eb9877dedd6f9e2425 is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 15:19:09 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Marking volume 11dfbd44-a70f-42ac-8a2c-25cb42c499a1 as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 15:19:09 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Copying metadata from image 879c41fa-33b0-4f02-add8-d6776b6162b6 to 11dfbd44-a70f-42ac-8a2c-25cb42c499a1. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 15:19:09 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Creating volume glance metadata for volume 11dfbd44-a70f-42ac-8a2c-25cb42c499a1 backed by image 879c41fa-33b0-4f02-add8-d6776b6162b6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '879c41fa-33b0-4f02-add8-d6776b6162b6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '057e4d6ab581990b59208e4eeda35daa', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 15:19:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f5f7c0-e60e-4cc9-8605-fd02ce265e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1', 'volume_size': 1, 'image_id': '879c41fa-33b0-4f02-add8-d6776b6162b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/879c41fa-33b0-4f02-add8-d6776b6162b6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '057e4d6ab581990b59208e4eeda35daa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '91af0e01e98546d2a58a626fd270309d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c92224852c391d370e1286073bfd99c369da81f644698d6fbd6d03736a8fade50997bde30de40dc84d14cddaeec2d478437bfd6337868d038129ede0c931cd73', 'id': '879c41fa-33b0-4f02-add8-d6776b6162b6', 'created_at': datetime.datetime(2026, 9, 25, 13, 19, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 19, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/879c41fa-33b0-4f02-add8-d6776b6162b6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76381b9aaff0>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfcb479-1baa-4289-8f64-157d10ccbf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:09 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Volume volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1 (11dfbd44-a70f-42ac-8a2c-25cb42c499a1): created successfully
Sep 25 15:19:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfcb479-1baa-4289-8f64-157d10ccbf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:09 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Flow 'volume_create_manager' (696d0045-15d1-4354-a1a8-682837dd1b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:09 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b5bd832a-8569-4728-86aa-33e48331e53b tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Created volume successfully.
Sep 25 15:19:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Acquiring lock "cinder-11dfbd44-a70f-42ac-8a2c-25cb42c499a1-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Lock "cinder-11dfbd44-a70f-42ac-8a2c-25cb42c499a1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Acquiring lock "cinder-quobyte-11dfbd44-a70f-42ac-8a2c-25cb42c499a1" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Lock "cinder-quobyte-11dfbd44-a70f-42ac-8a2c-25cb42c499a1" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:10 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb07349-5755-4e0c-a300-a16169c1679a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:10 devstack sudo[105396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1
Sep 25 15:19:10 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:10 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1" returned: 0 in 0.460s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:10 devstack sudo[105401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1
Sep 25 15:19:10 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:11 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11dfbd44-a70f-42ac-8a2c-25cb42c499a1" returned: 0 in 0.332s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Lock "cinder-quobyte-11dfbd44-a70f-42ac-8a2c-25cb42c499a1" released by "delete_volume" :: held 0.851s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:11 devstack cinder-volume[87071]: WARNING cinder.quota [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:19:11 devstack cinder-volume[87071]: WARNING cinder.quota [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 25 15:19:11 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Created reservations ['100cdd57-d739-4daa-8a2f-99aa955ce589', '97d1ac42-01ce-4ed2-a830-b887be012ca6', '831aeb3c-9499-4afc-90f5-28fd8f6e4b68', '40eaacf1-1f93-4d50-9555-ca360396fe2a'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:19:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:11 devstack sudo[105438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:19:11 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:11 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.465s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:11 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:19:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Deleted volume successfully.
Sep 25 15:19:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f6054ba7-c8fe-49a2-aef2-d5cbef518135 tempest-VolumeAndVolumeTypeFromImageTest-114312711 None] Lock "cinder-11dfbd44-a70f-42ac-8a2c-25cb42c499a1-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Flow 'volume_create_manager' (f7458deb-4fdf-4d2f-86ad-5cf9ba8ab85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c60cad-ce4d-43dc-ba6c-6fa552ef4ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c60cad-ce4d-43dc-ba6c-6fa552ef4ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-392069450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e062534-6620-4caa-ae59-4ffdc3b787a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3661a94b5a14cabac03ab8b3fb2aabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:17Z,use_quota=True,user_id='d8c8e408fef24500b7b67461a873dca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bf437a-06a9-4d7f-8915-5152bff298fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bf437a-06a9-4d7f-8915-5152bff298fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3e5b23-ba6a-4d95-a440-23f8181da2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3e5b23-ba6a-4d95-a440-23f8181da2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e062534-6620-4caa-ae59-4ffdc3b787a2', 'volume_name': 'volume-9e062534-6620-4caa-ae59-4ffdc3b787a2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4d7b9c-7360-4878-bc71-79ab07b8325d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4d7b9c-7360-4878-bc71-79ab07b8325d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd85b5ef-ef34-405e-82e4-a9d121d1f0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:17 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume 9e062534-6620-4caa-ae59-4ffdc3b787a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e062534-6620-4caa-ae59-4ffdc3b787a2', 'volume_size': 1}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-392069450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e062534-6620-4caa-ae59-4ffdc3b787a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3661a94b5a14cabac03ab8b3fb2aabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:17Z,use_quota=True,user_id='d8c8e408fef24500b7b67461a873dca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Creating volume 9e062534-6620-4caa-ae59-4ffdc3b787a2 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:19:17 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:17 devstack sudo[105443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2 1073741824
Sep 25 15:19:17 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:17 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2 1073741824" returned: 0 in 0.467s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:17 devstack sudo[105448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2
Sep 25 15:19:17 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:18 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2" returned: 0 in 0.265s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:19:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd85b5ef-ef34-405e-82e4-a9d121d1f0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e062534-6620-4caa-ae59-4ffdc3b787a2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba85d7d-4c24-4a47-8d10-a37c3a67e1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:18 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume volume-9e062534-6620-4caa-ae59-4ffdc3b787a2 (9e062534-6620-4caa-ae59-4ffdc3b787a2): created successfully
Sep 25 15:19:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba85d7d-4c24-4a47-8d10-a37c3a67e1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Flow 'volume_create_manager' (f7458deb-4fdf-4d2f-86ad-5cf9ba8ab85a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ea46ebe2-983a-45bd-98d1-d1ccf3b9dc23 tempest-CreateVolumesFromSnapshotTest-476908436 None] Created volume successfully.
Sep 25 15:19:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] Creating offline snapshot 7120f435-404d-47ae-8738-636dcf9477f4 of volume 9e062534-6620-4caa-ae59-4ffdc3b787a2 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:19:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cde271-82e1-4bbb-9b3f-3e0c240999dd]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:19 devstack sudo[105481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2
Sep 25 15:19:19 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:20 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2" returned: 0 in 0.502s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:20 devstack sudo[105498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4 1G
Sep 25 15:19:20 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:20 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4 1G" returned: 0 in 0.560s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e062534-6620-4caa-ae59-4ffdc3b787a2 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:20 devstack sudo[105504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e062534-6620-4caa-ae59-4ffdc3b787a2 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4
Sep 25 15:19:20 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:19:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:20 devstack sudo[105508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:19:20 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:21 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e062534-6620-4caa-ae59-4ffdc3b787a2 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4" returned: 0 in 0.379s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:21 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4 is being set with open permissions: ugo+rw
Sep 25 15:19:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:21 devstack sudo[105511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4
Sep 25 15:19:21 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:21 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.327s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:19:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:19:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 29 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:19:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>, <Thread(Rabbit-heartbeat, started daemon 129983531771584)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:19:21 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4" returned: 0 in 0.305s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:21 devstack sudo[105515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.info
Sep 25 15:19:21 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:21 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.info" returned: 0 in 0.313s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:21 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.info is being set with open permissions: ugo+rw
Sep 25 15:19:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:21 devstack sudo[105518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.info
Sep 25 15:19:21 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:22 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.info" returned: 0 in 0.332s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.509s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:22 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6b5f271c-f03c-4fff-b24e-f9ffefd2c8aa tempest-CreateVolumesFromSnapshotTest-476908436 None] Create snapshot completed successfully
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Flow 'volume_create_manager' (9053801b-c0ba-46e3-bf7f-75cf6eed6da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc6b04b-a296-4362-b11b-1d9ddf998ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc6b04b-a296-4362-b11b-1d9ddf998ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-544911880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b82542-70fa-44d3-8347-4c2440347cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3661a94b5a14cabac03ab8b3fb2aabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:23Z,use_quota=True,user_id='d8c8e408fef24500b7b67461a873dca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794fd6d3-a7c7-4144-bf3a-b2544c16096e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794fd6d3-a7c7-4144-bf3a-b2544c16096e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cccf465-2a1b-4fe3-a998-7278541d5320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cccf465-2a1b-4fe3-a998-7278541d5320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00b82542-70fa-44d3-8347-4c2440347cd1', 'volume_name': 'volume-00b82542-70fa-44d3-8347-4c2440347cd1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c827646e-a4a6-49b7-8dd9-7af0a6dd41d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c827646e-a4a6-49b7-8dd9-7af0a6dd41d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d9c4fd-0c0f-451b-8358-acfa3e5bdd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:23 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume 00b82542-70fa-44d3-8347-4c2440347cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00b82542-70fa-44d3-8347-4c2440347cd1', 'volume_size': 1}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-544911880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b82542-70fa-44d3-8347-4c2440347cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3661a94b5a14cabac03ab8b3fb2aabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:23Z,use_quota=True,user_id='d8c8e408fef24500b7b67461a873dca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Creating volume 00b82542-70fa-44d3-8347-4c2440347cd1 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:19:23 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-00b82542-70fa-44d3-8347-4c2440347cd1 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:23 devstack sudo[105521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-00b82542-70fa-44d3-8347-4c2440347cd1 1073741824
Sep 25 15:19:23 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Flow 'volume_create_manager' (8970354a-20c4-4767-896b-6073a1d84a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652d52bf-896a-4a03-ae4b-efdad3babefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652d52bf-896a-4a03-ae4b-efdad3babefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1559827570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3661a94b5a14cabac03ab8b3fb2aabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:24Z,use_quota=True,user_id='d8c8e408fef24500b7b67461a873dca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd59065-2597-4f35-9b74-9c1fbf794cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd59065-2597-4f35-9b74-9c1fbf794cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3e9491-f2b9-4864-a789-c621f354247e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3e9491-f2b9-4864-a789-c621f354247e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a', 'volume_name': 'volume-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a46549-2d0f-49f3-8239-702eb05df125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a46549-2d0f-49f3-8239-702eb05df125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aece4d24-cff1-4e2f-8edb-8630c5faade5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:23 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume 19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a', 'volume_size': 1}
Sep 25 15:19:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:24 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-00b82542-70fa-44d3-8347-4c2440347cd1 1073741824" returned: 0 in 0.638s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-00b82542-70fa-44d3-8347-4c2440347cd1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:24 devstack sudo[105527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-00b82542-70fa-44d3-8347-4c2440347cd1
Sep 25 15:19:24 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Flow 'volume_create_manager' (ee43ea7e-9a96-419b-856e-b8215a316aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef300b30-2ba6-4f43-bf91-edf58b24cbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef300b30-2ba6-4f43-bf91-edf58b24cbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-22162996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92574832-46d9-43c5-82ce-5c09a769197d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3661a94b5a14cabac03ab8b3fb2aabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:24Z,use_quota=True,user_id='d8c8e408fef24500b7b67461a873dca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc9e7c1-9077-48f8-99ea-b701e7c86238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc9e7c1-9077-48f8-99ea-b701e7c86238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3658e325-c63b-44c0-84c2-8964a69afbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3658e325-c63b-44c0-84c2-8964a69afbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92574832-46d9-43c5-82ce-5c09a769197d', 'volume_name': 'volume-92574832-46d9-43c5-82ce-5c09a769197d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d23b33-c8a9-42d6-b83b-d59149bb3f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d23b33-c8a9-42d6-b83b-d59149bb3f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3611c979-bc2a-4465-b93b-8924a38d6e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:24 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume 92574832-46d9-43c5-82ce-5c09a769197d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92574832-46d9-43c5-82ce-5c09a769197d', 'volume_size': 1}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:24 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-00b82542-70fa-44d3-8347-4c2440347cd1" returned: 0 in 0.332s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.539s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1559827570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3661a94b5a14cabac03ab8b3fb2aabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:24Z,use_quota=True,user_id='d8c8e408fef24500b7b67461a873dca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Creating volume 19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:19:24 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d9c4fd-0c0f-451b-8358-acfa3e5bdd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00b82542-70fa-44d3-8347-4c2440347cd1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:24 devstack sudo[105530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a 1073741824
Sep 25 15:19:24 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1bb77e-2c5c-4cb4-a687-6dbcff784e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:24 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume volume-00b82542-70fa-44d3-8347-4c2440347cd1 (00b82542-70fa-44d3-8347-4c2440347cd1): created successfully
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1bb77e-2c5c-4cb4-a687-6dbcff784e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Flow 'volume_create_manager' (9053801b-c0ba-46e3-bf7f-75cf6eed6da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5befea75-93d0-4081-9ea2-59162b8f182f tempest-CreateVolumesFromSnapshotTest-476908436 None] Created volume successfully.
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Flow 'volume_create_manager' (35bc36b5-9739-4646-9b04-eb70ffed6637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182fb70e-d2bf-4ae1-a9ab-10cba9e02adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182fb70e-d2bf-4ae1-a9ab-10cba9e02adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1287870695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da8e369-74d9-4f17-8b8d-71fabae251b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3661a94b5a14cabac03ab8b3fb2aabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:25Z,use_quota=True,user_id='d8c8e408fef24500b7b67461a873dca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2dbdf0-6582-41a9-8894-e062a2c35fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2dbdf0-6582-41a9-8894-e062a2c35fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208a5f9c-abe7-4c02-9b50-f2f6319f2ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208a5f9c-abe7-4c02-9b50-f2f6319f2ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3da8e369-74d9-4f17-8b8d-71fabae251b6', 'volume_name': 'volume-3da8e369-74d9-4f17-8b8d-71fabae251b6', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1883fe81-9076-483d-9c31-0970f19d79bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1883fe81-9076-483d-9c31-0970f19d79bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5097b47b-579c-4245-a0eb-3dac757711ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:24 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume 3da8e369-74d9-4f17-8b8d-71fabae251b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3da8e369-74d9-4f17-8b8d-71fabae251b6', 'volume_size': 1}
Sep 25 15:19:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:25 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a 1073741824" returned: 0 in 0.668s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:25 devstack sudo[105536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a
Sep 25 15:19:25 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Flow 'volume_create_manager' (fcb5027f-b132-43c5-9ae4-e7c49fc84b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0daf5c4-17dd-4d87-81bb-43d5af64b659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0daf5c4-17dd-4d87-81bb-43d5af64b659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1158677816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8ae30c-137e-48cd-b4dd-86e17fabd966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3661a94b5a14cabac03ab8b3fb2aabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:25Z,use_quota=True,user_id='d8c8e408fef24500b7b67461a873dca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d16a5b9-62e8-4461-845b-885588da58ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d16a5b9-62e8-4461-845b-885588da58ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963cb1f7-9c93-4a1e-8541-c1f0b9e52ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963cb1f7-9c93-4a1e-8541-c1f0b9e52ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c8ae30c-137e-48cd-b4dd-86e17fabd966', 'volume_name': 'volume-0c8ae30c-137e-48cd-b4dd-86e17fabd966', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a7f604-896e-407b-984c-57e21da4043a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a7f604-896e-407b-984c-57e21da4043a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4c69ec-7965-4191-8fbf-0efe07727759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:25 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume 0c8ae30c-137e-48cd-b4dd-86e17fabd966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c8ae30c-137e-48cd-b4dd-86e17fabd966', 'volume_size': 1}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:25 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a" returned: 0 in 0.282s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.166s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-22162996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92574832-46d9-43c5-82ce-5c09a769197d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3661a94b5a14cabac03ab8b3fb2aabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:24Z,use_quota=True,user_id='d8c8e408fef24500b7b67461a873dca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Creating volume 92574832-46d9-43c5-82ce-5c09a769197d {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:19:25 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-92574832-46d9-43c5-82ce-5c09a769197d 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aece4d24-cff1-4e2f-8edb-8630c5faade5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:25 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-92574832-46d9-43c5-82ce-5c09a769197d 1073741824
Sep 25 15:19:25 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e556e2f-b7d5-4088-b109-dda4fd1a1b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:25 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume volume-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a (19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a): created successfully
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e556e2f-b7d5-4088-b109-dda4fd1a1b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Flow 'volume_create_manager' (8970354a-20c4-4767-896b-6073a1d84a8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5cade9a4-f19f-4f6b-b441-8dd98ccb28af tempest-CreateVolumesFromSnapshotTest-476908436 None] Created volume successfully.
Sep 25 15:19:25 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-92574832-46d9-43c5-82ce-5c09a769197d 1073741824" returned: 0 in 0.502s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-92574832-46d9-43c5-82ce-5c09a769197d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:26 devstack sudo[105544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-92574832-46d9-43c5-82ce-5c09a769197d
Sep 25 15:19:26 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:26 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-92574832-46d9-43c5-82ce-5c09a769197d" returned: 0 in 0.295s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1287870695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da8e369-74d9-4f17-8b8d-71fabae251b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3661a94b5a14cabac03ab8b3fb2aabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:25Z,use_quota=True,user_id='d8c8e408fef24500b7b67461a873dca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Creating volume 3da8e369-74d9-4f17-8b8d-71fabae251b6 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:19:26 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3da8e369-74d9-4f17-8b8d-71fabae251b6 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3611c979-bc2a-4465-b93b-8924a38d6e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92574832-46d9-43c5-82ce-5c09a769197d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:26 devstack sudo[105547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3da8e369-74d9-4f17-8b8d-71fabae251b6 1073741824
Sep 25 15:19:26 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1913181-151f-4df0-af28-e9e85cf6c73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:26 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume volume-92574832-46d9-43c5-82ce-5c09a769197d (92574832-46d9-43c5-82ce-5c09a769197d): created successfully
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1913181-151f-4df0-af28-e9e85cf6c73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Flow 'volume_create_manager' (ee43ea7e-9a96-419b-856e-b8215a316aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9fb1f02c-b146-4921-9a1a-892a57eb7d2e tempest-CreateVolumesFromSnapshotTest-476908436 None] Created volume successfully.
Sep 25 15:19:26 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3da8e369-74d9-4f17-8b8d-71fabae251b6 1073741824" returned: 0 in 0.457s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3da8e369-74d9-4f17-8b8d-71fabae251b6 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:26 devstack sudo[105552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3da8e369-74d9-4f17-8b8d-71fabae251b6
Sep 25 15:19:26 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:27 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3da8e369-74d9-4f17-8b8d-71fabae251b6" returned: 0 in 0.248s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.766s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1158677816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8ae30c-137e-48cd-b4dd-86e17fabd966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3661a94b5a14cabac03ab8b3fb2aabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:25Z,use_quota=True,user_id='d8c8e408fef24500b7b67461a873dca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Creating volume 0c8ae30c-137e-48cd-b4dd-86e17fabd966 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:19:27 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c8ae30c-137e-48cd-b4dd-86e17fabd966 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5097b47b-579c-4245-a0eb-3dac757711ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3da8e369-74d9-4f17-8b8d-71fabae251b6', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:27 devstack sudo[105555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c8ae30c-137e-48cd-b4dd-86e17fabd966 1073741824
Sep 25 15:19:27 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22a86d8-f835-4f16-a690-091f72493641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:27 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume volume-3da8e369-74d9-4f17-8b8d-71fabae251b6 (3da8e369-74d9-4f17-8b8d-71fabae251b6): created successfully
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22a86d8-f835-4f16-a690-091f72493641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Flow 'volume_create_manager' (35bc36b5-9739-4646-9b04-eb70ffed6637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d8d25643-6e45-4d55-b4e0-ca9ea49d1000 tempest-CreateVolumesFromSnapshotTest-476908436 None] Created volume successfully.
Sep 25 15:19:27 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c8ae30c-137e-48cd-b4dd-86e17fabd966 1073741824" returned: 0 in 0.571s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c8ae30c-137e-48cd-b4dd-86e17fabd966 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:27 devstack sudo[105561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c8ae30c-137e-48cd-b4dd-86e17fabd966
Sep 25 15:19:27 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:27 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c8ae30c-137e-48cd-b4dd-86e17fabd966" returned: 0 in 0.264s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4c69ec-7965-4191-8fbf-0efe07727759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8ae30c-137e-48cd-b4dd-86e17fabd966', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:27 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7582b5ee-93ee-41fb-91c4-10df9f94288a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:27 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Volume volume-0c8ae30c-137e-48cd-b4dd-86e17fabd966 (0c8ae30c-137e-48cd-b4dd-86e17fabd966): created successfully
Sep 25 15:19:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7582b5ee-93ee-41fb-91c4-10df9f94288a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Flow 'volume_create_manager' (fcb5027f-b132-43c5-9ae4-e7c49fc84b1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e7f25d31-7335-4dcf-ad0c-9731926361d5 tempest-CreateVolumesFromSnapshotTest-476908436 None] Created volume successfully.
Sep 25 15:19:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "cinder-0c8ae30c-137e-48cd-b4dd-86e17fabd966-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-0c8ae30c-137e-48cd-b4dd-86e17fabd966-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "cinder-quobyte-0c8ae30c-137e-48cd-b4dd-86e17fabd966" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-quobyte-0c8ae30c-137e-48cd-b4dd-86e17fabd966" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5bd4ce-7c68-475a-91ae-155bc30618e4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c8ae30c-137e-48cd-b4dd-86e17fabd966 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:28 devstack sudo[105565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c8ae30c-137e-48cd-b4dd-86e17fabd966
Sep 25 15:19:28 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:29 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c8ae30c-137e-48cd-b4dd-86e17fabd966" returned: 0 in 0.452s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c8ae30c-137e-48cd-b4dd-86e17fabd966 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:29 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c8ae30c-137e-48cd-b4dd-86e17fabd966
Sep 25 15:19:29 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:29 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-0c8ae30c-137e-48cd-b4dd-86e17fabd966" returned: 0 in 0.260s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-quobyte-0c8ae30c-137e-48cd-b4dd-86e17fabd966" released by "delete_volume" :: held 0.760s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Created reservations ['25f7ba4b-b054-49fa-bc53-4215cde0b1fb', '2afce880-0f82-4deb-b19e-aaeec95289f0', 'a6902add-ac92-46c2-83b4-47836716cda3', '5eba8a58-e56e-4357-b3b9-c8af934a6512'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:29 devstack sudo[105579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:19:29 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "cinder-3da8e369-74d9-4f17-8b8d-71fabae251b6-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-3da8e369-74d9-4f17-8b8d-71fabae251b6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:29 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.290s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "cinder-quobyte-3da8e369-74d9-4f17-8b8d-71fabae251b6" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Deleted volume successfully.
Sep 25 15:19:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-quobyte-3da8e369-74d9-4f17-8b8d-71fabae251b6" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:30 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8fd68a-81a8-4274-ac03-37aea764a96b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3da8e369-74d9-4f17-8b8d-71fabae251b6 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-15699dfc-7242-44f5-9f2e-39d835ccef4c tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-0c8ae30c-137e-48cd-b4dd-86e17fabd966-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:30 devstack sudo[105582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3da8e369-74d9-4f17-8b8d-71fabae251b6
Sep 25 15:19:30 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:30 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3da8e369-74d9-4f17-8b8d-71fabae251b6" returned: 0 in 0.403s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3da8e369-74d9-4f17-8b8d-71fabae251b6 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:30 devstack sudo[105587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3da8e369-74d9-4f17-8b8d-71fabae251b6
Sep 25 15:19:30 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:30 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3da8e369-74d9-4f17-8b8d-71fabae251b6" returned: 0 in 0.287s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-quobyte-3da8e369-74d9-4f17-8b8d-71fabae251b6" released by "delete_volume" :: held 0.744s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:30 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Created reservations ['b8e2fa25-8b9d-467f-8b44-bd5f3f3d42c4', '168699ee-0084-4f05-a981-2b7cffd58899', 'fd53f7c9-4918-4d6e-ac55-342b5f2db230', '5137f86a-c7a1-4bc2-bd89-20e42923abec'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:19:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:30 devstack sudo[105592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:19:30 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "cinder-92574832-46d9-43c5-82ce-5c09a769197d-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-92574832-46d9-43c5-82ce-5c09a769197d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:31 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.306s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "cinder-quobyte-92574832-46d9-43c5-82ce-5c09a769197d" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Deleted volume successfully.
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-quobyte-92574832-46d9-43c5-82ce-5c09a769197d" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4fa3e873-7b25-466c-a10e-2fd940e06f83 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-3da8e369-74d9-4f17-8b8d-71fabae251b6-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca00636d-abaa-4e5c-9bbe-5e604730b9c1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-92574832-46d9-43c5-82ce-5c09a769197d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:31 devstack sudo[105595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-92574832-46d9-43c5-82ce-5c09a769197d
Sep 25 15:19:31 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:31 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-92574832-46d9-43c5-82ce-5c09a769197d" returned: 0 in 0.380s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-92574832-46d9-43c5-82ce-5c09a769197d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:31 devstack sudo[105600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-92574832-46d9-43c5-82ce-5c09a769197d
Sep 25 15:19:31 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:31 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-92574832-46d9-43c5-82ce-5c09a769197d" returned: 0 in 0.264s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-quobyte-92574832-46d9-43c5-82ce-5c09a769197d" released by "delete_volume" :: held 0.692s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Created reservations ['bf770be2-0cff-4edb-a594-a29ca9e4ed57', '51cea210-a123-43bd-8141-b65dfde026df', '40573af1-3337-484e-af87-381b9e83949c', '3621e80e-9a33-4118-a65f-1ad7f0f57039'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:32 devstack sudo[105603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:19:32 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:32 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "cinder-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.277s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:32 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:19:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Deleted volume successfully.
Sep 25 15:19:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2f8ec597-53dd-4684-869c-e8273986b11d tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-92574832-46d9-43c5-82ce-5c09a769197d-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "cinder-quobyte-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-quobyte-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:32 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b3c6cf-ca72-4690-a3b8-a8aff5171b58]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:32 devstack sudo[105606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a
Sep 25 15:19:32 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:32 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a" returned: 0 in 0.402s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:32 devstack sudo[105611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a
Sep 25 15:19:32 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:33 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a" returned: 0 in 0.254s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-quobyte-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a" released by "delete_volume" :: held 0.704s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Created reservations ['5ae5c8ff-bdea-477d-be9f-669c0983af77', 'ec4f907b-1dea-4070-a669-dc17a4e68324', '481ec6a1-fe86-4ff2-a57a-1b3e47a2e474', 'bbe2a74c-4702-4c6d-8be2-5e6f3e12dc50'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:33 devstack sudo[105614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:19:33 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:33 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.261s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "cinder-00b82542-70fa-44d3-8347-4c2440347cd1-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Deleted volume successfully.
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-00b82542-70fa-44d3-8347-4c2440347cd1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-624c337d-d2bb-436e-8b69-6513b5b7c278 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-19a3cc6f-7ad4-4fd7-9a9e-49364e3ce38a-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "cinder-quobyte-00b82542-70fa-44d3-8347-4c2440347cd1" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-quobyte-00b82542-70fa-44d3-8347-4c2440347cd1" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[948e3471-f172-42b8-9bd6-8b438e20cfbc]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-00b82542-70fa-44d3-8347-4c2440347cd1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:33 devstack sudo[105617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-00b82542-70fa-44d3-8347-4c2440347cd1
Sep 25 15:19:33 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:33 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-00b82542-70fa-44d3-8347-4c2440347cd1" returned: 0 in 0.376s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-00b82542-70fa-44d3-8347-4c2440347cd1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:33 devstack sudo[105622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-00b82542-70fa-44d3-8347-4c2440347cd1
Sep 25 15:19:33 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:34 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-00b82542-70fa-44d3-8347-4c2440347cd1" returned: 0 in 0.264s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-quobyte-00b82542-70fa-44d3-8347-4c2440347cd1" released by "delete_volume" :: held 0.690s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Created reservations ['d38136c2-c151-44ff-a8c0-51939211374f', 'ef28d126-04ec-45e9-b7f6-92113e5c87a7', '0a50fa82-d132-4b98-a9e7-bd08410d96d3', '0a6d7f12-b0d3-4973-9d76-7c889c19b53b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:34 devstack sudo[105625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:19:34 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:34 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "cinder-7120f435-404d-47ae-8738-636dcf9477f4-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.285s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:19:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Deleted volume successfully.
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-7120f435-404d-47ae-8738-636dcf9477f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "cinder-quobyte-9e062534-6620-4caa-ae59-4ffdc3b787a2" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-quobyte-9e062534-6620-4caa-ae59-4ffdc3b787a2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "cinder-quobyte-7120f435-404d-47ae-8738-636dcf9477f4" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1981aa6c-894d-4756-a060-79cc709e53b6 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-00b82542-70fa-44d3-8347-4c2440347cd1-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-quobyte-7120f435-404d-47ae-8738-636dcf9477f4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Deleting offline snapshot 7120f435-404d-47ae-8738-636dcf9477f4 of volume 9e062534-6620-4caa-ae59-4ffdc3b787a2 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] snapshot_file for this snap is: volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[88255ef4-e876-4b7a-aadb-fb03f426f44a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:34 devstack sudo[105629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4
Sep 25 15:19:34 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:35 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4" returned: 0 in 0.382s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e062534-6620-4caa-ae59-4ffdc3b787a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:19:35 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c68457b-f51c-45ca-bbfa-e5706989b331]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:35 devstack sudo[105634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2
Sep 25 15:19:35 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:35 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2" returned: 0 in 0.369s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:35 devstack sudo[105639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4
Sep 25 15:19:35 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:35 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4" returned: 0 in 0.339s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:35 devstack sudo[105644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4
Sep 25 15:19:35 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:36 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2.7120f435-404d-47ae-8738-636dcf9477f4" returned: 0 in 0.280s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-quobyte-7120f435-404d-47ae-8738-636dcf9477f4" released by "_delete_snapshot" :: held 1.483s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-quobyte-9e062534-6620-4caa-ae59-4ffdc3b787a2" released by "delete_snapshot" :: held 1.506s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:36 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Created reservations ['3403b504-6c74-494c-8bab-9fe54e688b72', 'fa7128b0-3333-4fb2-9ea2-b479588cdfbc', '011900a1-68b7-4ac5-8359-ad9ac2faf91a', '816bad5b-8270-4a1f-a601-d02d8dfa658e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:19:36 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Delete snapshot completed successfully.
Sep 25 15:19:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-279617a4-d3a3-4ed0-b750-d1c5f2cabc0b tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-7120f435-404d-47ae-8738-636dcf9477f4-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "cinder-9e062534-6620-4caa-ae59-4ffdc3b787a2-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-9e062534-6620-4caa-ae59-4ffdc3b787a2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "cinder-quobyte-9e062534-6620-4caa-ae59-4ffdc3b787a2" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-quobyte-9e062534-6620-4caa-ae59-4ffdc3b787a2" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:36 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d75fe53-7fa2-4692-a311-08594e9bc736]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:37 devstack sudo[105647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2
Sep 25 15:19:37 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:37 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2" returned: 0 in 0.378s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:37 devstack sudo[105652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2
Sep 25 15:19:37 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:37 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9e062534-6620-4caa-ae59-4ffdc3b787a2" returned: 0 in 0.285s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-quobyte-9e062534-6620-4caa-ae59-4ffdc3b787a2" released by "delete_volume" :: held 0.735s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:37 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Created reservations ['700eaae5-9425-4f61-8a26-eda45cc5f947', '583f1ab4-b3dc-4bc7-ae80-f1508ff18068', '706d4e30-7895-4e84-9518-dd67703010e1', '2b590cb0-f393-45a7-bd70-a0f6e82fd41e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:19:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:37 devstack sudo[105655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:19:37 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:38 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.311s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:38 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:19:38 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Deleted volume successfully.
Sep 25 15:19:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9dc5c3f7-e459-4c5e-9bc8-5278967ac322 tempest-CreateVolumesFromSnapshotTest-476908436 None] Lock "cinder-9e062534-6620-4caa-ae59-4ffdc3b787a2-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Flow 'volume_create_manager' (3c35aefa-5028-4934-b216-b4571bde2d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25f7daf-fe1b-4d74-9129-66339c9bf441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25f7daf-fe1b-4d74-9129-66339c9bf441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f220e1-3b6c-434d-9a26-eb92090ffee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e40dc97863420ea77e71a47c1eac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:41Z,use_quota=True,user_id='be98f7d831af462b83bd910b01479777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f644a7f6-3bcf-42ae-974c-3b7df6f2c477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f644a7f6-3bcf-42ae-974c-3b7df6f2c477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302ed6b5-b3a2-4ca7-8fd2-5e07706dfcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302ed6b5-b3a2-4ca7-8fd2-5e07706dfcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f220e1-3b6c-434d-9a26-eb92090ffee9', 'volume_name': 'volume-12f220e1-3b6c-434d-9a26-eb92090ffee9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5e94bb-c853-41ea-b697-1d1af08f5b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5e94bb-c853-41ea-b697-1d1af08f5b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1b972f-c619-437c-a567-cf2dd3c60eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:41 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Volume 12f220e1-3b6c-434d-9a26-eb92090ffee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f220e1-3b6c-434d-9a26-eb92090ffee9', 'volume_size': 1}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f220e1-3b6c-434d-9a26-eb92090ffee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e40dc97863420ea77e71a47c1eac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:41Z,use_quota=True,user_id='be98f7d831af462b83bd910b01479777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Creating volume 12f220e1-3b6c-434d-9a26-eb92090ffee9 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:19:41 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-12f220e1-3b6c-434d-9a26-eb92090ffee9 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:41 devstack sudo[105659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-12f220e1-3b6c-434d-9a26-eb92090ffee9 1073741824
Sep 25 15:19:41 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:41 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-12f220e1-3b6c-434d-9a26-eb92090ffee9 1073741824" returned: 0 in 0.439s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-12f220e1-3b6c-434d-9a26-eb92090ffee9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:41 devstack sudo[105664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-12f220e1-3b6c-434d-9a26-eb92090ffee9
Sep 25 15:19:41 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:42 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-12f220e1-3b6c-434d-9a26-eb92090ffee9" returned: 0 in 0.255s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:19:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1b972f-c619-437c-a567-cf2dd3c60eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f220e1-3b6c-434d-9a26-eb92090ffee9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9616d11-3dcd-4fe4-b0cf-975b8fcbd87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Volume volume-12f220e1-3b6c-434d-9a26-eb92090ffee9 (12f220e1-3b6c-434d-9a26-eb92090ffee9): created successfully
Sep 25 15:19:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9616d11-3dcd-4fe4-b0cf-975b8fcbd87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Flow 'volume_create_manager' (3c35aefa-5028-4934-b216-b4571bde2d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b23fadd6-8daa-41af-866b-0c619993d4d0 tempest-CinderUnicodeTest-893252746 None] Created volume successfully.
Sep 25 15:19:43 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Flow 'volume_create_manager' (010b75f6-e361-4082-a40e-e62751324342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966a1e5b-eb82-4adf-9cc3-a2606d1af333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966a1e5b-eb82-4adf-9cc3-a2606d1af333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-717857193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6408b2-97a8-4989-accd-1fa9c3eabe5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e40dc97863420ea77e71a47c1eac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:44Z,use_quota=True,user_id='be98f7d831af462b83bd910b01479777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96700d1b-f215-416a-8faf-8c96bddf37dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96700d1b-f215-416a-8faf-8c96bddf37dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52815784-abeb-4d70-9121-4caf045b9071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52815784-abeb-4d70-9121-4caf045b9071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf6408b2-97a8-4989-accd-1fa9c3eabe5a', 'volume_name': 'volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302e86af-7949-4dc2-9a07-85c1eb0f5084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302e86af-7949-4dc2-9a07-85c1eb0f5084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa630bf9-a328-4deb-b1cf-55c64975300c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:44 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Volume bf6408b2-97a8-4989-accd-1fa9c3eabe5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a', 'volume_size': 1}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:19:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-717857193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6408b2-97a8-4989-accd-1fa9c3eabe5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e40dc97863420ea77e71a47c1eac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:19:44Z,use_quota=True,user_id='be98f7d831af462b83bd910b01479777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Creating volume bf6408b2-97a8-4989-accd-1fa9c3eabe5a {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:19:44 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:44 devstack sudo[105673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a 1073741824
Sep 25 15:19:44 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:44 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a 1073741824" returned: 0 in 0.567s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:44 devstack sudo[105688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a
Sep 25 15:19:44 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:45 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a" returned: 0 in 0.315s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:19:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa630bf9-a328-4deb-b1cf-55c64975300c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cdd8ab-2f72-4145-9e76-5288b97c6a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:19:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Volume volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a (bf6408b2-97a8-4989-accd-1fa9c3eabe5a): created successfully
Sep 25 15:19:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cdd8ab-2f72-4145-9e76-5288b97c6a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:19:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Flow 'volume_create_manager' (010b75f6-e361-4082-a40e-e62751324342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:19:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-445aa495-8d10-41b8-8d48-f8d6b7f84979 tempest-CinderUnicodeTest-893252746 None] Created volume successfully.
Sep 25 15:19:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] Creating offline snapshot 769b5a3e-c43d-4ddb-947f-f1db4baf9ba7 of volume bf6408b2-97a8-4989-accd-1fa9c3eabe5a {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:19:46 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ce5497-4bf2-4dfb-8e79-5063f36a639a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:46 devstack sudo[105700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a
Sep 25 15:19:46 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-29ec7c9b-785c-499d-ae14-3bbb68f93347 req-0558ae7a-d8da-4350-a6cb-16339491ca9c tempest-TestShelveInstance-2137677980 None] Terminate volume connection completed successfully.
Sep 25 15:19:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-29ec7c9b-785c-499d-ae14-3bbb68f93347 req-0558ae7a-d8da-4350-a6cb-16339491ca9c tempest-TestShelveInstance-2137677980 None] Deleting attachment b54f65af-4105-4fa6-a680-336a5543a9be. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:19:47 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a" returned: 0 in 0.530s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:47 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7 1G
Sep 25 15:19:47 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:47 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7 1G" returned: 0 in 0.475s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:47 devstack sudo[105722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7
Sep 25 15:19:47 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:47 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7" returned: 0 in 0.272s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:47 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7 is being set with open permissions: ugo+rw
Sep 25 15:19:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:47 devstack sudo[105727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7
Sep 25 15:19:47 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:48 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7" returned: 0 in 0.232s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:48 devstack sudo[105731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.info
Sep 25 15:19:48 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:48 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.info" returned: 0 in 0.298s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:48 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.info is being set with open permissions: ugo+rw
Sep 25 15:19:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:48 devstack sudo[105734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.info
Sep 25 15:19:48 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:48 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.info" returned: 0 in 0.297s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.262s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d7efaed1-23da-419e-aa4a-e7cb18f2ef6a tempest-CinderUnicodeTest-893252746 None] Create snapshot completed successfully
Sep 25 15:19:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Acquiring lock "cinder-769b5a3e-c43d-4ddb-947f-f1db4baf9ba7-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Lock "cinder-769b5a3e-c43d-4ddb-947f-f1db4baf9ba7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Acquiring lock "cinder-quobyte-bf6408b2-97a8-4989-accd-1fa9c3eabe5a" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Lock "cinder-quobyte-bf6408b2-97a8-4989-accd-1fa9c3eabe5a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Acquiring lock "cinder-quobyte-769b5a3e-c43d-4ddb-947f-f1db4baf9ba7" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Lock "cinder-quobyte-769b5a3e-c43d-4ddb-947f-f1db4baf9ba7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Deleting offline snapshot 769b5a3e-c43d-4ddb-947f-f1db4baf9ba7 of volume bf6408b2-97a8-4989-accd-1fa9c3eabe5a {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:19:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] snapshot_file for this snap is: volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:19:49 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c571d1-2c67-4d8a-b68e-aa68886ea270]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:49 devstack sudo[105742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7
Sep 25 15:19:49 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-bef70181-59d0-465c-9a97-568f8fff2ce0 req-59d72dd3-213b-4388-882d-bcd777f99ea4 tempest-TestShelveInstance-2137677980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-bef70181-59d0-465c-9a97-568f8fff2ce0 req-59d72dd3-213b-4388-882d-bcd777f99ea4 tempest-TestShelveInstance-2137677980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-bef70181-59d0-465c-9a97-568f8fff2ce0 req-59d72dd3-213b-4388-882d-bcd777f99ea4 tempest-TestShelveInstance-2137677980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-bef70181-59d0-465c-9a97-568f8fff2ce0 req-59d72dd3-213b-4388-882d-bcd777f99ea4 tempest-TestShelveInstance-2137677980 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf', 'name': 'volume-7735623f-a435-419a-b1ed-29f3b8661529', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7287b2de-6d14-4955-a072-7d2992598c22', 'enforce_multipath': True} {{(pid=87071) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 15:19:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-bef70181-59d0-465c-9a97-568f8fff2ce0 req-59d72dd3-213b-4388-882d-bcd777f99ea4 tempest-TestShelveInstance-2137677980 None] attachment_update completed successfully.
Sep 25 15:19:50 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7" returned: 0 in 0.457s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:19:50 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1c4f9f-ed1f-4f33-8b6a-c7beb907f505]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:50 devstack sudo[105754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a
Sep 25 15:19:50 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:50 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a" returned: 0 in 0.434s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:50 devstack sudo[105759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7
Sep 25 15:19:50 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:51 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7" returned: 0 in 0.357s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:51 devstack sudo[105764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7
Sep 25 15:19:51 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:51 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a.769b5a3e-c43d-4ddb-947f-f1db4baf9ba7" returned: 0 in 0.323s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Lock "cinder-quobyte-769b5a3e-c43d-4ddb-947f-f1db4baf9ba7" released by "_delete_snapshot" :: held 1.725s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Lock "cinder-quobyte-bf6408b2-97a8-4989-accd-1fa9c3eabe5a" released by "delete_snapshot" :: held 1.760s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:51 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Created reservations ['dc9be9d6-c949-4dfd-bce6-e4bd8f7d934b', 'cf4c8610-3dc7-40c8-b749-d7933cd86f61', '96c44a1e-b7ea-44ef-891d-adca137224d0', 'f9dde41e-245e-4578-804c-ba1831bcef15'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:19:51 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Delete snapshot completed successfully.
Sep 25 15:19:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0cf75eb5-2de8-4e95-ae0e-2dcbb1b2c5e6 tempest-CinderUnicodeTest-893252746 None] Lock "cinder-769b5a3e-c43d-4ddb-947f-f1db4baf9ba7-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Acquiring lock "cinder-bf6408b2-97a8-4989-accd-1fa9c3eabe5a-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Lock "cinder-bf6408b2-97a8-4989-accd-1fa9c3eabe5a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Acquiring lock "cinder-quobyte-bf6408b2-97a8-4989-accd-1fa9c3eabe5a" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Lock "cinder-quobyte-bf6408b2-97a8-4989-accd-1fa9c3eabe5a" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7c8efe-c412-43fc-80ef-18f9636eb0ad]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:52 devstack sudo[105768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a
Sep 25 15:19:52 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:52 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a" returned: 0 in 0.380s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:52 devstack sudo[105773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a
Sep 25 15:19:52 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:52 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-bf6408b2-97a8-4989-accd-1fa9c3eabe5a" returned: 0 in 0.326s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Lock "cinder-quobyte-bf6408b2-97a8-4989-accd-1fa9c3eabe5a" released by "delete_volume" :: held 0.807s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:52 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Created reservations ['f2a9cff8-9a82-4840-96fa-e1dc5b7bf817', '67ba0054-eef9-4a0b-8e68-aa63fd9a5a59', '7c9000c3-c3cf-4954-9d25-52586c516bc0', '5d945d78-aebd-41ff-8021-ecaed907f19b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:19:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:53 devstack sudo[105875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:19:53 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Acquiring lock "cinder-12f220e1-3b6c-434d-9a26-eb92090ffee9-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Lock "cinder-12f220e1-3b6c-434d-9a26-eb92090ffee9-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Acquiring lock "cinder-quobyte-12f220e1-3b6c-434d-9a26-eb92090ffee9" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:19:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Lock "cinder-quobyte-12f220e1-3b6c-434d-9a26-eb92090ffee9" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:19:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e815aee9-54ee-4046-8cd9-78c9e99d2389]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:19:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-12f220e1-3b6c-434d-9a26-eb92090ffee9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:53 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.648s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:53 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:19:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Deleted volume successfully.
Sep 25 15:19:53 devstack sudo[105983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-12f220e1-3b6c-434d-9a26-eb92090ffee9
Sep 25 15:19:53 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e818d741-3312-4368-8145-6690fcb9d002 tempest-CinderUnicodeTest-893252746 None] Lock "cinder-bf6408b2-97a8-4989-accd-1fa9c3eabe5a-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:54 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-12f220e1-3b6c-434d-9a26-eb92090ffee9" returned: 0 in 0.638s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-12f220e1-3b6c-434d-9a26-eb92090ffee9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:54 devstack sudo[106250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-12f220e1-3b6c-434d-9a26-eb92090ffee9
Sep 25 15:19:54 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:54 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-12f220e1-3b6c-434d-9a26-eb92090ffee9" returned: 0 in 0.329s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Lock "cinder-quobyte-12f220e1-3b6c-434d-9a26-eb92090ffee9" released by "delete_volume" :: held 1.064s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:19:54 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Created reservations ['4c6fa5ba-b4f8-463a-96be-b1403503cdea', '437ec6c4-192f-4b94-9e5c-c3eb44e0a54f', '58601372-5a5a-49ba-bebd-118f26816e9c', '9b42e6c1-d98c-48c1-8aa1-76961389e78c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:19:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:19:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:19:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:19:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:19:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:19:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:19:54 devstack sudo[106265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:19:54 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:19:54 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root
Sep 25 15:19:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.311s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:19:54 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:19:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Deleted volume successfully.
Sep 25 15:19:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-cd693f58-6a5d-46aa-860c-386670ee0934 tempest-CinderUnicodeTest-893252746 None] Lock "cinder-12f220e1-3b6c-434d-9a26-eb92090ffee9-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:20:04 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=91,cinder:INSERT=29,cinder:UPDATE=125,cinder:DELETE=9 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:20:04 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=106,cinder:SELECT=94,cinder:INSERT=35,cinder:DELETE=11 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:20:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:20:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:20:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:20:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:20:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:20:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:20:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:20 devstack sudo[106369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:20:20 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:21 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.282s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:20:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:20:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 29 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:20:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>, <Thread(Rabbit-heartbeat, started daemon 129983531771584)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:20:35 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-ca135332-cdfb-4670-8bc7-592349e289ac tempest-TestShelveInstance-2137677980 None] Terminate volume connection completed successfully.
Sep 25 15:20:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-ca135332-cdfb-4670-8bc7-592349e289ac tempest-TestShelveInstance-2137677980 None] Deleting attachment 7287b2de-6d14-4955-a072-7d2992598c22. {{(pid=87071) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 15:20:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Acquiring lock "cinder-7735623f-a435-419a-b1ed-29f3b8661529-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:20:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Lock "cinder-7735623f-a435-419a-b1ed-29f3b8661529-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:20:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Acquiring lock "cinder-quobyte-7735623f-a435-419a-b1ed-29f3b8661529" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:20:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Lock "cinder-quobyte-7735623f-a435-419a-b1ed-29f3b8661529" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:20:36 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4046bf1b-8ef8-4db3-a9e7-c02814bee24f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:20:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:36 devstack sudo[106408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529
Sep 25 15:20:36 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:36 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529" returned: 0 in 0.437s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:36 devstack sudo[106413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529
Sep 25 15:20:36 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:36 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7735623f-a435-419a-b1ed-29f3b8661529" returned: 0 in 0.271s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Lock "cinder-quobyte-7735623f-a435-419a-b1ed-29f3b8661529" released by "delete_volume" :: held 0.758s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:20:36 devstack cinder-volume[87071]: DEBUG cinder.quota [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Created reservations ['76a96b30-f900-4959-b963-fe974322ab5a', '2f1c58fd-8a0a-43b7-8ba7-f52b94da2b78', '50cc5cbe-5705-496c-9e3c-64e050e39d20', 'e1391f80-ad37-4530-a404-7d0fdf38e081'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:20:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:20:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:20:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:20:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:20:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:20:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:37 devstack sudo[106416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:20:37 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:37 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.281s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:37 devstack cinder-volume[87071]: DEBUG cinder.manager [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:20:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Deleted volume successfully.
Sep 25 15:20:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [req-405a9050-b11a-4866-bd20-255a7fdd9a19 req-acf29fa1-a85e-4575-91da-5f7215244569 tempest-TestShelveInstance-2137677980 None] Lock "cinder-7735623f-a435-419a-b1ed-29f3b8661529-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:20:47 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:20:47 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Flow 'volume_create_manager' (af3406c9-29a7-45fe-becf-170031ff9b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1213a9bd-5a59-4c13-975e-8485c6b293c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1213a9bd-5a59-4c13-975e-8485c6b293c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87533a13-0751-43c6-b503-b097e9fc7c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa8521445c541fba9ccfd15a2a965e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:20:51Z,use_quota=True,user_id='047d8e1ca76045119c2e9bfe00c6cd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de606770-9253-4f76-8f88-910d70afd900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de606770-9253-4f76-8f88-910d70afd900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b9574b-5a67-452c-8faf-9a54d3c47288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b9574b-5a67-452c-8faf-9a54d3c47288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87533a13-0751-43c6-b503-b097e9fc7c9a', 'volume_name': 'volume-87533a13-0751-43c6-b503-b097e9fc7c9a', 'volume_size': 1, 'image_id': '081fa414-af56-42e0-b03c-dfe39a4bc4d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/081fa414-af56-42e0-b03c-dfe39a4bc4d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a474a9ee9b3ea9321761c706ace7dbdd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1fa8521445c541fba9ccfd15a2a965e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00e13a13febec22688a8c0a267492e59d2baa1e8fc71fb982c7c3445c9277701cff1d31f94407b97ad1366b7ffcbc373c53a5c043ba6ec8b3eee73a787866826', 'id': '081fa414-af56-42e0-b03c-dfe39a4bc4d6', 'created_at': datetime.datetime(2026, 9, 25, 13, 20, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 20, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/081fa414-af56-42e0-b03c-dfe39a4bc4d6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x763825bae990>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0df2fce-d6cb-4067-a15a-67ac30e820b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0df2fce-d6cb-4067-a15a-67ac30e820b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a7fb30-f098-4348-b228-60cd47e13ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:20:51 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Volume 87533a13-0751-43c6-b503-b097e9fc7c9a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87533a13-0751-43c6-b503-b097e9fc7c9a', 'volume_size': 1, 'image_id': '081fa414-af56-42e0-b03c-dfe39a4bc4d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/081fa414-af56-42e0-b03c-dfe39a4bc4d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a474a9ee9b3ea9321761c706ace7dbdd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1fa8521445c541fba9ccfd15a2a965e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00e13a13febec22688a8c0a267492e59d2baa1e8fc71fb982c7c3445c9277701cff1d31f94407b97ad1366b7ffcbc373c53a5c043ba6ec8b3eee73a787866826', 'id': '081fa414-af56-42e0-b03c-dfe39a4bc4d6', 'created_at': datetime.datetime(2026, 9, 25, 13, 20, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 20, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/081fa414-af56-42e0-b03c-dfe39a4bc4d6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x763825bae990>}
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Trying to clone 87533a13-0751-43c6-b503-b097e9fc7c9a from image 081fa414-af56-42e0-b03c-dfe39a4bc4d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/081fa414-af56-42e0-b03c-dfe39a4bc4d6', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 15:20:51 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[031ce714-6a43-49e0-849c-b7fc0855666e]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:51 devstack sudo[106426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD
Sep 25 15:20:51 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:51 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD" returned: 0 in 0.310s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:52 devstack sudo[106430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD
Sep 25 15:20:52 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:52 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:20:52 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Temporary image 081fa414-af56-42e0-b03c-dfe39a4bc4d6 is fetched for user 047d8e1ca76045119c2e9bfe00c6cd90. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 15:20:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e474af82-7b71-46a7-9e08-11f32dab03a6]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:20:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:52 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD
Sep 25 15:20:52 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:52 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:52 devstack sudo[106441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD
Sep 25 15:20:52 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:52 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:20:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87533a13-0751-43c6-b503-b097e9fc7c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa8521445c541fba9ccfd15a2a965e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:20:51Z,use_quota=True,user_id='047d8e1ca76045119c2e9bfe00c6cd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Creating volume 87533a13-0751-43c6-b503-b097e9fc7c9a {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:20:53 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:53 devstack sudo[106446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a 1073741824
Sep 25 15:20:53 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:53 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a 1073741824" returned: 0 in 0.443s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:53 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a
Sep 25 15:20:53 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:53 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a" returned: 0 in 0.257s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Attempting download of 081fa414-af56-42e0-b03c-dfe39a4bc4d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/081fa414-af56-42e0-b03c-dfe39a4bc4d6', 'metadata': {}}])) to volume 87533a13-0751-43c6-b503-b097e9fc7c9a. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e937c0-5131-4d27-a26c-fb5b524bc039]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:20:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_081fa414-af56-42e0-b03c-dfe39a4bc4d6_63ip2b8n {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:53 devstack sudo[106455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_081fa414-af56-42e0-b03c-dfe39a4bc4d6_63ip2b8n
Sep 25 15:20:53 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:54 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_081fa414-af56-42e0-b03c-dfe39a4bc4d6_63ip2b8n" returned: 0 in 0.348s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_081fa414-af56-42e0-b03c-dfe39a4bc4d6_63ip2b8n {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:54 devstack sudo[106459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_081fa414-af56-42e0-b03c-dfe39a4bc4d6_63ip2b8n
Sep 25 15:20:54 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:54 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_081fa414-af56-42e0-b03c-dfe39a4bc4d6_63ip2b8n" returned: 1 in 0.360s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_081fa414-af56-42e0-b03c-dfe39a4bc4d6_63ip2b8n' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:20:54 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[13faa999-82f2-4b54-9703-ad7cfd3f112f]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:20:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:54 devstack sudo[106463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD
Sep 25 15:20:54 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:54 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:55 devstack sudo[106467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD
Sep 25 15:20:55 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:55 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:20:55 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] 081fa414-af56-42e0-b03c-dfe39a4bc4d6 was raw, converting to qcow2 {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 15:20:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:55 devstack sudo[106472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a
Sep 25 15:20:55 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:55 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a" returned: 0 in 0.477s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:55 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_081fa414-af56-42e0-b03c-dfe39a4bc4d6_93yc6nycdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:20:55 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 15:20:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:55 devstack sudo[106483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a 1G
Sep 25 15:20:55 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:56 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a 1G" returned: 0 in 0.296s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:56 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Downloaded image 081fa414-af56-42e0-b03c-dfe39a4bc4d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/081fa414-af56-42e0-b03c-dfe39a4bc4d6', 'metadata': {}}])) to volume 87533a13-0751-43c6-b503-b097e9fc7c9a successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 15:20:56 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Temporary image 081fa414-af56-42e0-b03c-dfe39a4bc4d6 for user 047d8e1ca76045119c2e9bfe00c6cd90 is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 15:20:56 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Marking volume 87533a13-0751-43c6-b503-b097e9fc7c9a as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 15:20:56 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Copying metadata from image 081fa414-af56-42e0-b03c-dfe39a4bc4d6 to 87533a13-0751-43c6-b503-b097e9fc7c9a. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 15:20:56 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Creating volume glance metadata for volume 87533a13-0751-43c6-b503-b097e9fc7c9a backed by image 081fa414-af56-42e0-b03c-dfe39a4bc4d6 with: {'image_id': '081fa414-af56-42e0-b03c-dfe39a4bc4d6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a474a9ee9b3ea9321761c706ace7dbdd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 15:20:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a7fb30-f098-4348-b228-60cd47e13ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87533a13-0751-43c6-b503-b097e9fc7c9a', 'volume_size': 1, 'image_id': '081fa414-af56-42e0-b03c-dfe39a4bc4d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/081fa414-af56-42e0-b03c-dfe39a4bc4d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a474a9ee9b3ea9321761c706ace7dbdd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1fa8521445c541fba9ccfd15a2a965e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00e13a13febec22688a8c0a267492e59d2baa1e8fc71fb982c7c3445c9277701cff1d31f94407b97ad1366b7ffcbc373c53a5c043ba6ec8b3eee73a787866826', 'id': '081fa414-af56-42e0-b03c-dfe39a4bc4d6', 'created_at': datetime.datetime(2026, 9, 25, 13, 20, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 20, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/081fa414-af56-42e0-b03c-dfe39a4bc4d6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x763825bae990>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:20:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de15ed04-531b-4649-b6d5-6d4f8436fb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:20:56 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Volume volume-87533a13-0751-43c6-b503-b097e9fc7c9a (87533a13-0751-43c6-b503-b097e9fc7c9a): created successfully
Sep 25 15:20:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de15ed04-531b-4649-b6d5-6d4f8436fb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:20:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Flow 'volume_create_manager' (af3406c9-29a7-45fe-becf-170031ff9b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:20:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0d41f727-0ab1-4edc-b0f2-10e22509b41a tempest-VolumeImageDependencyTests-1217389308 None] Created volume successfully.
Sep 25 15:20:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Acquiring lock "cinder-87533a13-0751-43c6-b503-b097e9fc7c9a-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:20:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Lock "cinder-87533a13-0751-43c6-b503-b097e9fc7c9a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:20:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Acquiring lock "cinder-quobyte-87533a13-0751-43c6-b503-b097e9fc7c9a" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:20:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Lock "cinder-quobyte-87533a13-0751-43c6-b503-b097e9fc7c9a" acquired by "delete_volume" :: waited 0.013s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:20:56 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f775469-6daf-4b1b-a6f9-7b2dabd2901d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:20:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:56 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a
Sep 25 15:20:56 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:57 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a" returned: 0 in 0.346s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:57 devstack sudo[106493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a
Sep 25 15:20:57 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:57 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-87533a13-0751-43c6-b503-b097e9fc7c9a" returned: 0 in 0.240s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Lock "cinder-quobyte-87533a13-0751-43c6-b503-b097e9fc7c9a" released by "delete_volume" :: held 0.628s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:20:57 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Created reservations ['34de7762-23bc-4dbe-9bbe-5d823035c354', '0dcebf52-a249-4950-9b2e-1220318ddb09', '278ade1e-cc18-4581-a455-06cefd54acff', '1abc08d7-d503-4bca-ba46-3c37f5b6d618'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:20:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:20:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:20:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:20:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:20:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:20:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:20:57 devstack sudo[106496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:20:57 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:20:57 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root
Sep 25 15:20:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.244s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:20:57 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:20:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Deleted volume successfully.
Sep 25 15:20:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3dc60b26-3979-4671-9958-e076e31f607f tempest-VolumeImageDependencyTests-1217389308 None] Lock "cinder-87533a13-0751-43c6-b503-b097e9fc7c9a-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Flow 'volume_create_manager' (500ff748-d539-4999-a909-499f6af9c070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208fc81d-8eef-4af7-b2dc-974274beef41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208fc81d-8eef-4af7-b2dc-974274beef41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1931811670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775d215d-f192-4e72-bcf6-06cadc053971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49369742485e4fc5bace8e411c969b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:01Z,use_quota=True,user_id='57a13b7ed6f543da8cf9edc3d29b1a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3ce2a5-fd49-450b-b089-cc9bb945a260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3ce2a5-fd49-450b-b089-cc9bb945a260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9458ee58-6367-456a-8ee3-dfcceeebc569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9458ee58-6367-456a-8ee3-dfcceeebc569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '775d215d-f192-4e72-bcf6-06cadc053971', 'volume_name': 'volume-775d215d-f192-4e72-bcf6-06cadc053971', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2a8bfd-30c8-41eb-bfa2-f2f0e3ddade5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2a8bfd-30c8-41eb-bfa2-f2f0e3ddade5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d2fe71-78c8-4c65-9655-a97387fb2eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:01 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Volume 775d215d-f192-4e72-bcf6-06cadc053971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-775d215d-f192-4e72-bcf6-06cadc053971', 'volume_size': 1}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1931811670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775d215d-f192-4e72-bcf6-06cadc053971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49369742485e4fc5bace8e411c969b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:01Z,use_quota=True,user_id='57a13b7ed6f543da8cf9edc3d29b1a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Creating volume 775d215d-f192-4e72-bcf6-06cadc053971 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:01 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-775d215d-f192-4e72-bcf6-06cadc053971 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:01 devstack sudo[106502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-775d215d-f192-4e72-bcf6-06cadc053971 1073741824
Sep 25 15:21:01 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:01 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-775d215d-f192-4e72-bcf6-06cadc053971 1073741824" returned: 0 in 0.468s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-775d215d-f192-4e72-bcf6-06cadc053971 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:01 devstack sudo[106508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-775d215d-f192-4e72-bcf6-06cadc053971
Sep 25 15:21:01 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:02 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-775d215d-f192-4e72-bcf6-06cadc053971" returned: 0 in 0.241s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d2fe71-78c8-4c65-9655-a97387fb2eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-775d215d-f192-4e72-bcf6-06cadc053971', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574dac74-b1d2-42c1-a804-0979638cdcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:02 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Volume volume-775d215d-f192-4e72-bcf6-06cadc053971 (775d215d-f192-4e72-bcf6-06cadc053971): created successfully
Sep 25 15:21:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574dac74-b1d2-42c1-a804-0979638cdcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:02 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Flow 'volume_create_manager' (500ff748-d539-4999-a909-499f6af9c070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:02 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-48c3b72a-7aef-4afc-b3ab-1bf6482f2ad9 tempest-ProjectReaderTests-1611510845 None] Created volume successfully.
Sep 25 15:21:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Acquiring lock "cinder-775d215d-f192-4e72-bcf6-06cadc053971-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Lock "cinder-775d215d-f192-4e72-bcf6-06cadc053971-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Acquiring lock "cinder-quobyte-775d215d-f192-4e72-bcf6-06cadc053971" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Lock "cinder-quobyte-775d215d-f192-4e72-bcf6-06cadc053971" acquired by "delete_volume" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:02 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[443b9351-1318-48f6-88f0-c84913bce1af]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-775d215d-f192-4e72-bcf6-06cadc053971 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:02 devstack sudo[106511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-775d215d-f192-4e72-bcf6-06cadc053971
Sep 25 15:21:02 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:02 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-775d215d-f192-4e72-bcf6-06cadc053971" returned: 0 in 0.416s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-775d215d-f192-4e72-bcf6-06cadc053971 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:02 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-775d215d-f192-4e72-bcf6-06cadc053971
Sep 25 15:21:02 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:03 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-775d215d-f192-4e72-bcf6-06cadc053971" returned: 0 in 0.269s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Lock "cinder-quobyte-775d215d-f192-4e72-bcf6-06cadc053971" released by "delete_volume" :: held 0.734s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:03 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Created reservations ['28f90d93-4636-4495-8153-5f4b3c89ef98', '5982c974-e2c0-4121-8dfa-7bf1c215a8b5', '14b55be4-6d8c-496c-a963-ecede399b023', 'adbc015b-8d7f-4395-a614-77fa8020ac22'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:03 devstack sudo[106519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:21:03 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:03 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.279s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:03 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:21:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Deleted volume successfully.
Sep 25 15:21:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-52b2a0d3-80b4-44fd-9d43-65954b9c0669 tempest-ProjectReaderTests-1611510845 None] Lock "cinder-775d215d-f192-4e72-bcf6-06cadc053971-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Flow 'volume_create_manager' (4e5170e3-25f4-4c07-ad07-ff9bfde6b893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28457b97-0772-4af5-831a-4a90d2d463e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28457b97-0772-4af5-831a-4a90d2d463e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145922022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094c6d1e-591c-4900-b138-95ffc82e9bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49369742485e4fc5bace8e411c969b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:04Z,use_quota=True,user_id='57a13b7ed6f543da8cf9edc3d29b1a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6d16fd-753e-43ae-864e-0bfd44935c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6d16fd-753e-43ae-864e-0bfd44935c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5542619-ffa9-4f25-9bbe-a9213f1b06f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5542619-ffa9-4f25-9bbe-a9213f1b06f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '094c6d1e-591c-4900-b138-95ffc82e9bea', 'volume_name': 'volume-094c6d1e-591c-4900-b138-95ffc82e9bea', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b84d7b4-81c1-4b4e-bb0f-18161b5e5a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b84d7b4-81c1-4b4e-bb0f-18161b5e5a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d49dd93-8bd8-4383-b536-6a9753332e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:04 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Volume 094c6d1e-591c-4900-b138-95ffc82e9bea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-094c6d1e-591c-4900-b138-95ffc82e9bea', 'volume_size': 1}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145922022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094c6d1e-591c-4900-b138-95ffc82e9bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49369742485e4fc5bace8e411c969b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:04Z,use_quota=True,user_id='57a13b7ed6f543da8cf9edc3d29b1a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Creating volume 094c6d1e-591c-4900-b138-95ffc82e9bea {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:04 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-094c6d1e-591c-4900-b138-95ffc82e9bea 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:04 devstack sudo[106522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-094c6d1e-591c-4900-b138-95ffc82e9bea 1073741824
Sep 25 15:21:04 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:04 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-094c6d1e-591c-4900-b138-95ffc82e9bea 1073741824" returned: 0 in 0.459s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-094c6d1e-591c-4900-b138-95ffc82e9bea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:04 devstack sudo[106528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-094c6d1e-591c-4900-b138-95ffc82e9bea
Sep 25 15:21:04 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:04 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-094c6d1e-591c-4900-b138-95ffc82e9bea" returned: 0 in 0.248s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d49dd93-8bd8-4383-b536-6a9753332e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-094c6d1e-591c-4900-b138-95ffc82e9bea', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1d741d-d24a-423a-8149-68c51624b79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:04 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Volume volume-094c6d1e-591c-4900-b138-95ffc82e9bea (094c6d1e-591c-4900-b138-95ffc82e9bea): created successfully
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1d741d-d24a-423a-8149-68c51624b79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Flow 'volume_create_manager' (4e5170e3-25f4-4c07-ad07-ff9bfde6b893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:04 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-854a91e9-a1b4-4e42-b409-1a1f3b32e1c3 tempest-ProjectReaderTests-1611510845 None] Created volume successfully.
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Acquiring lock "cinder-094c6d1e-591c-4900-b138-95ffc82e9bea-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Lock "cinder-094c6d1e-591c-4900-b138-95ffc82e9bea-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Acquiring lock "cinder-quobyte-094c6d1e-591c-4900-b138-95ffc82e9bea" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Lock "cinder-quobyte-094c6d1e-591c-4900-b138-95ffc82e9bea" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[442bdcc1-2ed1-4733-a026-6f0cc8641356]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-094c6d1e-591c-4900-b138-95ffc82e9bea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:05 devstack sudo[106531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-094c6d1e-591c-4900-b138-95ffc82e9bea
Sep 25 15:21:05 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:05 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-094c6d1e-591c-4900-b138-95ffc82e9bea" returned: 0 in 0.369s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-094c6d1e-591c-4900-b138-95ffc82e9bea {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:05 devstack sudo[106536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-094c6d1e-591c-4900-b138-95ffc82e9bea
Sep 25 15:21:05 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:05 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-094c6d1e-591c-4900-b138-95ffc82e9bea" returned: 0 in 0.241s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Lock "cinder-quobyte-094c6d1e-591c-4900-b138-95ffc82e9bea" released by "delete_volume" :: held 0.657s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Created reservations ['46827366-83e6-4d6b-b224-c3818cb27a98', 'a3639a3a-e141-46aa-a28e-e82ba200cbff', '9eea0112-d458-4e33-a594-bcaefe350ee6', '29a37880-a250-46ee-864a-53b815a78922'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:05 devstack sudo[106539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:21:05 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:06 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.235s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:06 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:21:06 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Deleted volume successfully.
Sep 25 15:21:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0fe2bb0b-70bd-498b-83d2-b6d297c2c751 tempest-ProjectReaderTests-1611510845 None] Lock "cinder-094c6d1e-591c-4900-b138-95ffc82e9bea-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:15 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=32,cinder:UPDATE=33,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Flow 'volume_create_manager' (4ff3f116-ce3e-46ed-a498-5a9c3ba7b796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9af97a-4e2f-492b-9396-a7b38f3c166e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9af97a-4e2f-492b-9396-a7b38f3c166e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1088852291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d62743-e2c3-4157-a3f5-500f0ca94df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73aae7f8aaea4c9ead06238fd479d19e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:20Z,use_quota=True,user_id='726ae08d07ae431e9a235adcd6ff34d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d10dd48-e262-4bd6-abdd-8132719b88f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d10dd48-e262-4bd6-abdd-8132719b88f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a629ff-8865-4102-8ddc-7e793ec974ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a629ff-8865-4102-8ddc-7e793ec974ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d62743-e2c3-4157-a3f5-500f0ca94df1', 'volume_name': 'volume-d9d62743-e2c3-4157-a3f5-500f0ca94df1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (972995d6-146a-4278-9b61-cb2fcf78e9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (972995d6-146a-4278-9b61-cb2fcf78e9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbaff467-cbfd-487b-af7a-59aead8d5754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:19 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Volume d9d62743-e2c3-4157-a3f5-500f0ca94df1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d62743-e2c3-4157-a3f5-500f0ca94df1', 'volume_size': 1}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1088852291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d62743-e2c3-4157-a3f5-500f0ca94df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73aae7f8aaea4c9ead06238fd479d19e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:20Z,use_quota=True,user_id='726ae08d07ae431e9a235adcd6ff34d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Creating volume d9d62743-e2c3-4157-a3f5-500f0ca94df1 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:19 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d9d62743-e2c3-4157-a3f5-500f0ca94df1 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:19 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:19 devstack sudo[106617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d9d62743-e2c3-4157-a3f5-500f0ca94df1 1073741824
Sep 25 15:21:19 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Flow 'volume_create_manager' (79bee8d9-51d6-419c-92e5-bf8f77f86b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c3f2c9-b2c3-4031-bfd7-2f5c56dcb4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c3f2c9-b2c3-4031-bfd7-2f5c56dcb4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1661358135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a51daf-c85e-4f9e-8448-f45133b0cdbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ffedfd74274cdbafb088231daadf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:20Z,use_quota=True,user_id='b3ef44678fcd47bf903740fe9a433a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35be8de-167f-4696-9719-9c7c6eb379d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35be8de-167f-4696-9719-9c7c6eb379d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ccee71-5c80-4935-b62b-877959716e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ccee71-5c80-4935-b62b-877959716e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09a51daf-c85e-4f9e-8448-f45133b0cdbc', 'volume_name': 'volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa45f3d-8da5-4e1f-9dbe-ce5e4722ec7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa45f3d-8da5-4e1f-9dbe-ce5e4722ec7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d84dd2a-a615-4a86-9fb7-cccd7f9a156d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Volume 09a51daf-c85e-4f9e-8448-f45133b0cdbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc', 'volume_size': 1}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Flow 'volume_create_manager' (9034a470-5085-4028-b3b5-c9b074a3fb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5358c6-ff49-4019-952d-5425eaa8adac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5358c6-ff49-4019-952d-5425eaa8adac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-281533792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4b59f9-b78c-4419-908e-77508b048d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73aae7f8aaea4c9ead06238fd479d19e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:20Z,use_quota=True,user_id='726ae08d07ae431e9a235adcd6ff34d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623a3352-f027-4b13-b34c-a5994fe5f313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623a3352-f027-4b13-b34c-a5994fe5f313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee6ba37-f5f7-4369-9a53-3cdd0587f44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee6ba37-f5f7-4369-9a53-3cdd0587f44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b4b59f9-b78c-4419-908e-77508b048d70', 'volume_name': 'volume-5b4b59f9-b78c-4419-908e-77508b048d70', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db55fb80-3f4b-4868-8825-570ca1abfc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db55fb80-3f4b-4868-8825-570ca1abfc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7fe79d-624c-48d3-951f-5ea5844033c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Volume 5b4b59f9-b78c-4419-908e-77508b048d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b4b59f9-b78c-4419-908e-77508b048d70', 'volume_size': 1}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Flow 'volume_create_manager' (de09ad5c-0463-4fe8-abd3-7499219a3fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742fd7e3-b3f7-47d7-ab4a-08e0bbc0b3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742fd7e3-b3f7-47d7-ab4a-08e0bbc0b3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-46009260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b0632d-e6df-45c4-822c-2482f6a997bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0ee6010e1f4fa5b7dd927f489aa468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:21Z,use_quota=True,user_id='9150ab29e86448d78f0f84a90d929d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b184efdb-2864-42f2-882a-3e5f5575a937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b184efdb-2864-42f2-882a-3e5f5575a937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50e4885-8215-4f89-9f97-e90f94cda1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50e4885-8215-4f89-9f97-e90f94cda1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b0632d-e6df-45c4-822c-2482f6a997bd', 'volume_name': 'volume-c0b0632d-e6df-45c4-822c-2482f6a997bd', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3015e719-83e7-4712-8d46-94edf311a525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3015e719-83e7-4712-8d46-94edf311a525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ee72d0-676f-48f7-aa1d-ac536b1abf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume c0b0632d-e6df-45c4-822c-2482f6a997bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b0632d-e6df-45c4-822c-2482f6a997bd', 'volume_size': 1}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:20 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d9d62743-e2c3-4157-a3f5-500f0ca94df1 1073741824" returned: 0 in 0.758s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d9d62743-e2c3-4157-a3f5-500f0ca94df1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:20 devstack sudo[106623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d9d62743-e2c3-4157-a3f5-500f0ca94df1
Sep 25 15:21:20 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Flow 'volume_create_manager' (a6922e30-bd30-4db1-a06b-3344d612265b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddda403c-36bd-4eb2-a71c-3671192accec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddda403c-36bd-4eb2-a71c-3671192accec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-198361764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f348318b-63a3-40a2-bd70-90f0a3034ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73aae7f8aaea4c9ead06238fd479d19e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:21Z,use_quota=True,user_id='726ae08d07ae431e9a235adcd6ff34d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3591a5-7c7b-4a94-a72d-3f581ab21968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b3591a5-7c7b-4a94-a72d-3f581ab21968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89d46b5-5383-4757-831c-e2e871be984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89d46b5-5383-4757-831c-e2e871be984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f348318b-63a3-40a2-bd70-90f0a3034ea0', 'volume_name': 'volume-f348318b-63a3-40a2-bd70-90f0a3034ea0', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b096d5a4-4511-43c6-b319-05cda42d1d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b096d5a4-4511-43c6-b319-05cda42d1d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97dbbb9-280b-4e15-9358-b9e276c6675c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:20 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Volume f348318b-63a3-40a2-bd70-90f0a3034ea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f348318b-63a3-40a2-bd70-90f0a3034ea0', 'volume_size': 1}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:21 devstack sudo[106625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:21:21 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:21 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d9d62743-e2c3-4157-a3f5-500f0ca94df1" returned: 0 in 0.335s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1661358135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a51daf-c85e-4f9e-8448-f45133b0cdbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ffedfd74274cdbafb088231daadf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:20Z,use_quota=True,user_id='b3ef44678fcd47bf903740fe9a433a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Creating volume 09a51daf-c85e-4f9e-8448-f45133b0cdbc {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:21 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbaff467-cbfd-487b-af7a-59aead8d5754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d62743-e2c3-4157-a3f5-500f0ca94df1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc162dce-025e-4855-92ba-e9ef88c30e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:21 devstack sudo[106628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc 1073741824
Sep 25 15:21:21 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:21 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Volume volume-d9d62743-e2c3-4157-a3f5-500f0ca94df1 (d9d62743-e2c3-4157-a3f5-500f0ca94df1): created successfully
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc162dce-025e-4855-92ba-e9ef88c30e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Flow 'volume_create_manager' (4ff3f116-ce3e-46ed-a498-5a9c3ba7b796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b8a2c1a2-10a1-4422-879d-b6cd54cfac1f tempest-CreateVolumesFromImageTest-862127739 None] Created volume successfully.
Sep 25 15:21:21 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.460s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 29 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>, <Thread(Rabbit-heartbeat, started daemon 129983531771584)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Flow 'volume_create_manager' (afb8f043-13dc-486a-bc3b-3f248209404f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9141ad1-e13c-4d0e-a743-a7e3ab7eb44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9141ad1-e13c-4d0e-a743-a7e3ab7eb44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-623760276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79e36c6-613c-4e1b-a726-87cf6bccac57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73aae7f8aaea4c9ead06238fd479d19e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:21Z,use_quota=True,user_id='726ae08d07ae431e9a235adcd6ff34d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42fc6d4-a7ed-4a11-846f-6a8531db9b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42fc6d4-a7ed-4a11-846f-6a8531db9b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da33280-dfbc-491f-803a-6b60abd9322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da33280-dfbc-491f-803a-6b60abd9322b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e79e36c6-613c-4e1b-a726-87cf6bccac57', 'volume_name': 'volume-e79e36c6-613c-4e1b-a726-87cf6bccac57', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b147de-eca5-45c6-8a1f-f4032b9cbc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b147de-eca5-45c6-8a1f-f4032b9cbc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40631a86-2244-4612-a47f-eceb19ac338a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:21 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Volume e79e36c6-613c-4e1b-a726-87cf6bccac57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e79e36c6-613c-4e1b-a726-87cf6bccac57', 'volume_size': 1}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:21 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc 1073741824" returned: 0 in 0.718s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:21 devstack sudo[106635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc
Sep 25 15:21:21 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Flow 'volume_create_manager' (6eaee328-df90-460d-884c-14ba9960e32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4630ff4-45cb-4e4a-915d-5a747bccfe36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:22 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4630ff4-45cb-4e4a-915d-5a747bccfe36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1068926482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b241806-783b-45e1-968c-fc67a38e433f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73aae7f8aaea4c9ead06238fd479d19e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:22Z,use_quota=True,user_id='726ae08d07ae431e9a235adcd6ff34d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2ed6996-a139-4228-9862-aa223d2bb20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2ed6996-a139-4228-9862-aa223d2bb20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efb00a0-b894-402b-b6b9-813f4c5cf164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efb00a0-b894-402b-b6b9-813f4c5cf164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b241806-783b-45e1-968c-fc67a38e433f', 'volume_name': 'volume-1b241806-783b-45e1-968c-fc67a38e433f', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4cc19c-c793-4512-b069-4d4ac43cea74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4cc19c-c793-4512-b069-4d4ac43cea74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c829bbb-fd74-4377-b98d-2ba74b9dfbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:22 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Volume 1b241806-783b-45e1-968c-fc67a38e433f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b241806-783b-45e1-968c-fc67a38e433f', 'volume_size': 1}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc" returned: 0 in 0.353s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.782s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-281533792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4b59f9-b78c-4419-908e-77508b048d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73aae7f8aaea4c9ead06238fd479d19e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:20Z,use_quota=True,user_id='726ae08d07ae431e9a235adcd6ff34d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Creating volume 5b4b59f9-b78c-4419-908e-77508b048d70 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:22 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b4b59f9-b78c-4419-908e-77508b048d70 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d84dd2a-a615-4a86-9fb7-cccd7f9a156d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:22 devstack sudo[106638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b4b59f9-b78c-4419-908e-77508b048d70 1073741824
Sep 25 15:21:22 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19713eaa-bf56-4cca-b376-399c96e5f9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:22 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Volume volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc (09a51daf-c85e-4f9e-8448-f45133b0cdbc): created successfully
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19713eaa-bf56-4cca-b376-399c96e5f9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Flow 'volume_create_manager' (79bee8d9-51d6-419c-92e5-bf8f77f86b53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:22 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-280832f3-0325-4026-adb1-497d850182c8 tempest-VolumeDependencyTests-326416441 None] Created volume successfully.
Sep 25 15:21:22 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b4b59f9-b78c-4419-908e-77508b048d70 1073741824" returned: 0 in 0.590s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b4b59f9-b78c-4419-908e-77508b048d70 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:22 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b4b59f9-b78c-4419-908e-77508b048d70
Sep 25 15:21:22 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:23 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b4b59f9-b78c-4419-908e-77508b048d70" returned: 0 in 0.277s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.445s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-46009260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b0632d-e6df-45c4-822c-2482f6a997bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0ee6010e1f4fa5b7dd927f489aa468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:21Z,use_quota=True,user_id='9150ab29e86448d78f0f84a90d929d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Creating volume c0b0632d-e6df-45c4-822c-2482f6a997bd {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:23 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:23 devstack sudo[106647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd 1073741824
Sep 25 15:21:23 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7fe79d-624c-48d3-951f-5ea5844033c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b4b59f9-b78c-4419-908e-77508b048d70', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80820b10-f878-4114-bbf4-acb9db00cb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:23 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Volume volume-5b4b59f9-b78c-4419-908e-77508b048d70 (5b4b59f9-b78c-4419-908e-77508b048d70): created successfully
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80820b10-f878-4114-bbf4-acb9db00cb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Flow 'volume_create_manager' (9034a470-5085-4028-b3b5-c9b074a3fb62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-989fb533-3642-4118-82b7-db9fe03ad36a tempest-CreateVolumesFromImageTest-862127739 None] Created volume successfully.
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:23 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd 1073741824" returned: 0 in 0.566s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:23 devstack sudo[106655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd
Sep 25 15:21:23 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:24 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd" returned: 0 in 0.284s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.094s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-198361764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f348318b-63a3-40a2-bd70-90f0a3034ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73aae7f8aaea4c9ead06238fd479d19e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:21Z,use_quota=True,user_id='726ae08d07ae431e9a235adcd6ff34d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Creating volume f348318b-63a3-40a2-bd70-90f0a3034ea0 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:24 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f348318b-63a3-40a2-bd70-90f0a3034ea0 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ee72d0-676f-48f7-aa1d-ac536b1abf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b0632d-e6df-45c4-822c-2482f6a997bd', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:24 devstack sudo[106658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f348318b-63a3-40a2-bd70-90f0a3034ea0 1073741824
Sep 25 15:21:24 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a3c224-16e5-474c-a555-ae57da7ae04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:24 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume volume-c0b0632d-e6df-45c4-822c-2482f6a997bd (c0b0632d-e6df-45c4-822c-2482f6a997bd): created successfully
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a3c224-16e5-474c-a555-ae57da7ae04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Flow 'volume_create_manager' (de09ad5c-0463-4fe8-abd3-7499219a3fb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-09cf32a0-550e-47b3-9ca5-b53ab1258451 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Created volume successfully.
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Flow 'volume_create_manager' (ca9f0503-0d7e-4096-a3ca-cab4568e784c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec889190-867a-475f-9507-bd64c1d81dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:24 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec889190-867a-475f-9507-bd64c1d81dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=373e04b1-5110-4ed2-89e6-cfe5c8d3a524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23655b82863c434c83d0ada112c146d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:24Z,use_quota=True,user_id='475c523bf51c42369b595c464c0532d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc485527-a21c-458e-b389-b67abd1faa5d),volume_type_id=dc485527-a21c-458e-b389-b67abd1faa5d)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403121a2-c186-43b0-8608-50dbd0e281d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403121a2-c186-43b0-8608-50dbd0e281d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338af111-ac68-4d06-98ee-29fe3723e4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f348318b-63a3-40a2-bd70-90f0a3034ea0 1073741824" returned: 0 in 0.531s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f348318b-63a3-40a2-bd70-90f0a3034ea0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:24 devstack sudo[106664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f348318b-63a3-40a2-bd70-90f0a3034ea0
Sep 25 15:21:24 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338af111-ac68-4d06-98ee-29fe3723e4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '373e04b1-5110-4ed2-89e6-cfe5c8d3a524', 'volume_name': 'volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524', 'volume_size': 1, 'image_id': '1bbb269c-3edf-432f-ab28-0843e65b3308', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bbb269c-3edf-432f-ab28-0843e65b3308', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0986059611456e99301f96b8e1bfc51b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23655b82863c434c83d0ada112c146d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'abfaddf705a25b2992bc837cd02cc6362dd90715a98f9b8bbdc0e6f5e8c471b59e486e31f5bfc9d78f8af223bcaf0336c0326f99e6d25e79e70c49afe8f539ab', 'id': '1bbb269c-3edf-432f-ab28-0843e65b3308', 'created_at': datetime.datetime(2026, 9, 25, 13, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 21, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bbb269c-3edf-432f-ab28-0843e65b3308/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7638263d1130>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb509e50-19f5-4b50-9a2d-82b389d34bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb509e50-19f5-4b50-9a2d-82b389d34bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6a4914-58dc-4e68-be00-5ade357542da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:24 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Volume 373e04b1-5110-4ed2-89e6-cfe5c8d3a524: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524', 'volume_size': 1, 'image_id': '1bbb269c-3edf-432f-ab28-0843e65b3308', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bbb269c-3edf-432f-ab28-0843e65b3308', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0986059611456e99301f96b8e1bfc51b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23655b82863c434c83d0ada112c146d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'abfaddf705a25b2992bc837cd02cc6362dd90715a98f9b8bbdc0e6f5e8c471b59e486e31f5bfc9d78f8af223bcaf0336c0326f99e6d25e79e70c49afe8f539ab', 'id': '1bbb269c-3edf-432f-ab28-0843e65b3308', 'created_at': datetime.datetime(2026, 9, 25, 13, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 21, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bbb269c-3edf-432f-ab28-0843e65b3308/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7638263d1130>}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Trying to clone 373e04b1-5110-4ed2-89e6-cfe5c8d3a524 from image 1bbb269c-3edf-432f-ab28-0843e65b3308 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1bbb269c-3edf-432f-ab28-0843e65b3308', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 15:21:24 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f348318b-63a3-40a2-bd70-90f0a3034ea0" returned: 0 in 0.285s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.289s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-623760276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79e36c6-613c-4e1b-a726-87cf6bccac57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73aae7f8aaea4c9ead06238fd479d19e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:21Z,use_quota=True,user_id='726ae08d07ae431e9a235adcd6ff34d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Creating volume e79e36c6-613c-4e1b-a726-87cf6bccac57 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:24 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e79e36c6-613c-4e1b-a726-87cf6bccac57 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 15:21:24 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 15:21:24 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e79e36c6-613c-4e1b-a726-87cf6bccac57 1073741824
Sep 25 15:21:24 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97dbbb9-280b-4e15-9358-b9e276c6675c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f348318b-63a3-40a2-bd70-90f0a3034ea0', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:24 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6aa2d6-a4d3-4c99-b6cc-71525421fc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:25 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Volume volume-f348318b-63a3-40a2-bd70-90f0a3034ea0 (f348318b-63a3-40a2-bd70-90f0a3034ea0): created successfully
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6aa2d6-a4d3-4c99-b6cc-71525421fc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Flow 'volume_create_manager' (a6922e30-bd30-4db1-a06b-3344d612265b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0fcb05-7f06-4d35-8750-e8815f1ee4d0]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6f936733-fceb-48f9-9160-e62e914507a1 tempest-CreateVolumesFromImageTest-862127739 None] Created volume successfully.
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:25 devstack sudo[106669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD
Sep 25 15:21:25 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:25 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:25 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e79e36c6-613c-4e1b-a726-87cf6bccac57 1073741824" returned: 0 in 0.533s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e79e36c6-613c-4e1b-a726-87cf6bccac57 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:25 devstack sudo[106678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e79e36c6-613c-4e1b-a726-87cf6bccac57
Sep 25 15:21:25 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:25 devstack sudo[106677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD
Sep 25 15:21:25 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:25 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD" returned: 1 in 0.331s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Temporary image 1bbb269c-3edf-432f-ab28-0843e65b3308 is fetched for user 475c523bf51c42369b595c464c0532d7. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 15:21:25 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e79e36c6-613c-4e1b-a726-87cf6bccac57" returned: 0 in 0.303s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.624s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1068926482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b241806-783b-45e1-968c-fc67a38e433f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73aae7f8aaea4c9ead06238fd479d19e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:22Z,use_quota=True,user_id='726ae08d07ae431e9a235adcd6ff34d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Creating volume 1b241806-783b-45e1-968c-fc67a38e433f {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:25 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1b241806-783b-45e1-968c-fc67a38e433f 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cc4663-6a3f-4c90-bfa5-559cda6e1f21]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:25 devstack sudo[106685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1b241806-783b-45e1-968c-fc67a38e433f 1073741824
Sep 25 15:21:25 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40631a86-2244-4612-a47f-eceb19ac338a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e79e36c6-613c-4e1b-a726-87cf6bccac57', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e746de-a1ba-41f1-995a-8045a9bdc551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:25 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Volume volume-e79e36c6-613c-4e1b-a726-87cf6bccac57 (e79e36c6-613c-4e1b-a726-87cf6bccac57): created successfully
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e746de-a1ba-41f1-995a-8045a9bdc551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Flow 'volume_create_manager' (afb8f043-13dc-486a-bc3b-3f248209404f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8fc5bdef-d8f7-4530-9104-bef1989c1de4 tempest-CreateVolumesFromImageTest-862127739 None] Created volume successfully.
Sep 25 15:21:25 devstack sudo[106686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD
Sep 25 15:21:25 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:26 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:26 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1b241806-783b-45e1-968c-fc67a38e433f 1073741824" returned: 0 in 0.441s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:26 devstack sudo[106694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD
Sep 25 15:21:26 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1b241806-783b-45e1-968c-fc67a38e433f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:26 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1b241806-783b-45e1-968c-fc67a38e433f
Sep 25 15:21:26 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:26 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD" returned: 1 in 0.362s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:26 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1b241806-783b-45e1-968c-fc67a38e433f" returned: 0 in 0.260s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.969s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] Creating offline snapshot 8c85ce23-02d3-4839-bcdc-888de2b42486 of volume 09a51daf-c85e-4f9e-8448-f45133b0cdbc {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c829bbb-fd74-4377-b98d-2ba74b9dfbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b241806-783b-45e1-968c-fc67a38e433f', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d9b452-b901-4beb-97ca-ac71d09b5c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fea632-a0d2-48e6-a901-e6f095de169f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:26 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Volume volume-1b241806-783b-45e1-968c-fc67a38e433f (1b241806-783b-45e1-968c-fc67a38e433f): created successfully
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d9b452-b901-4beb-97ca-ac71d09b5c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Flow 'volume_create_manager' (6eaee328-df90-460d-884c-14ba9960e32b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2554ca07-0b0e-4abd-831d-690727cb9506 tempest-CreateVolumesFromImageTest-862127739 None] Created volume successfully.
Sep 25 15:21:26 devstack sudo[106703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc
Sep 25 15:21:26 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:26 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc" returned: 0 in 0.340s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:26 devstack sudo[106708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486 1G
Sep 25 15:21:26 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:27 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486 1G" returned: 0 in 0.434s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:27 devstack sudo[106714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486
Sep 25 15:21:27 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:27 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486" returned: 0 in 0.307s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:27 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486 is being set with open permissions: ugo+rw
Sep 25 15:21:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "cinder-1b241806-783b-45e1-968c-fc67a38e433f-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:27 devstack sudo[106719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486
Sep 25 15:21:27 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-1b241806-783b-45e1-968c-fc67a38e433f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "cinder-quobyte-1b241806-783b-45e1-968c-fc67a38e433f" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-quobyte-1b241806-783b-45e1-968c-fc67a38e433f" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:27 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1400b026-d635-4665-8f38-feaf1f494ead]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1b241806-783b-45e1-968c-fc67a38e433f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:27 devstack sudo[106721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1b241806-783b-45e1-968c-fc67a38e433f
Sep 25 15:21:27 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:27 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486" returned: 0 in 0.259s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:28 devstack sudo[106724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.info
Sep 25 15:21:28 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:28 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1b241806-783b-45e1-968c-fc67a38e433f" returned: 0 in 0.366s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1b241806-783b-45e1-968c-fc67a38e433f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:28 devstack sudo[106731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1b241806-783b-45e1-968c-fc67a38e433f
Sep 25 15:21:28 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:28 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.info" returned: 0 in 0.271s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:28 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.info is being set with open permissions: ugo+rw
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:28 devstack sudo[106733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.info
Sep 25 15:21:28 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:28 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.info" returned: 0 in 0.230s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:28 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.365s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-1b241806-783b-45e1-968c-fc67a38e433f" returned: 0 in 0.325s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] Creating offline snapshot 0641bc0b-0b86-4b55-bdbe-4817e1321155 of volume c0b0632d-e6df-45c4-822c-2482f6a997bd {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-quobyte-1b241806-783b-45e1-968c-fc67a38e433f" released by "delete_volume" :: held 0.752s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b25edd0c-df64-4911-ba34-957e3e3cb90f tempest-VolumeDependencyTests-326416441 None] Create snapshot completed successfully
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[148901e5-2915-4d22-81d4-dbd703a9bf8c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Created reservations ['2b2c6349-b040-4924-bcf5-f146e9530152', '1319ea21-38a1-410a-95db-c9cb5761003d', 'bbf0c57c-7781-414e-89a9-7e0fc2ca8f8a', '944c1539-017e-4aa5-a73b-2d59161e910b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:28 devstack sudo[106737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd
Sep 25 15:21:28 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:28 devstack sudo[106739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:21:28 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "cinder-e79e36c6-613c-4e1b-a726-87cf6bccac57-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-e79e36c6-613c-4e1b-a726-87cf6bccac57-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:29 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.294s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:21:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Deleted volume successfully.
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "cinder-quobyte-e79e36c6-613c-4e1b-a726-87cf6bccac57" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:29 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-quobyte-e79e36c6-613c-4e1b-a726-87cf6bccac57" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd" returned: 0 in 0.498s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0736a6ad-4c26-4ae5-b607-e5328fcde072 tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-1b241806-783b-45e1-968c-fc67a38e433f-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38dc416-21d1-4053-ade7-1a0a4f5e1424]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e79e36c6-613c-4e1b-a726-87cf6bccac57 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:29 devstack sudo[106745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155 1G
Sep 25 15:21:29 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:29 devstack sudo[106746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e79e36c6-613c-4e1b-a726-87cf6bccac57
Sep 25 15:21:29 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:29 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e79e36c6-613c-4e1b-a726-87cf6bccac57" returned: 0 in 0.395s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e79e36c6-613c-4e1b-a726-87cf6bccac57 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:29 devstack sudo[106757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e79e36c6-613c-4e1b-a726-87cf6bccac57
Sep 25 15:21:29 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:29 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155 1G" returned: 0 in 0.535s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b0632d-e6df-45c4-822c-2482f6a997bd -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:29 devstack sudo[106759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b0632d-e6df-45c4-822c-2482f6a997bd -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155
Sep 25 15:21:29 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Flow 'volume_create_manager' (03b22b73-e619-416a-a38d-6a10b1e57567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639f6edd-4120-453b-8268-2aa9f65d828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639f6edd-4120-453b-8268-2aa9f65d828f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1957538920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e768de-e366-4f7d-8cb1-14240050f431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ffedfd74274cdbafb088231daadf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8c85ce23-02d3-4839-bcdc-888de2b42486,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:30Z,use_quota=True,user_id='b3ef44678fcd47bf903740fe9a433a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:29 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601dd068-56d3-443e-b8b5-9f3b98f52d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601dd068-56d3-443e-b8b5-9f3b98f52d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59c913e-19a4-4f65-8e71-4f9762a64788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59c913e-19a4-4f65-8e71-4f9762a64788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '11e768de-e366-4f7d-8cb1-14240050f431', 'volume_name': 'volume-11e768de-e366-4f7d-8cb1-14240050f431', 'volume_size': 1, 'snapshot_id': '8c85ce23-02d3-4839-bcdc-888de2b42486'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e991b074-2a5e-4f23-9569-8808422c18b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e991b074-2a5e-4f23-9569-8808422c18b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96dc48f7-f6e6-453f-8861-307d1c5042fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:29 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Volume 11e768de-e366-4f7d-8cb1-14240050f431: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-11e768de-e366-4f7d-8cb1-14240050f431', 'volume_size': 1, 'snapshot_id': '8c85ce23-02d3-4839-bcdc-888de2b42486'}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e79e36c6-613c-4e1b-a726-87cf6bccac57" returned: 0 in 0.341s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-quobyte-e79e36c6-613c-4e1b-a726-87cf6bccac57" released by "delete_volume" :: held 0.794s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Created reservations ['33c3b1bc-3abc-4f65-a6b5-2fadbc1f10d2', 'e21e7631-441f-4708-8eae-45b85186db9c', '939f284b-0e53-4f9e-a9cb-7c13609aabd0', '5a5056e0-1856-47b6-a6d4-7d72afd889d3'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:29 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b0632d-e6df-45c4-822c-2482f6a997bd -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155" returned: 0 in 0.359s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:29 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155 is being set with open permissions: ugo+rw
Sep 25 15:21:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:30 devstack sudo[106765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155
Sep 25 15:21:30 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:30 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:21:30 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "cinder-f348318b-63a3-40a2-bd70-90f0a3034ea0-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-f348318b-63a3-40a2-bd70-90f0a3034ea0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "cinder-quobyte-f348318b-63a3-40a2-bd70-90f0a3034ea0" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-quobyte-f348318b-63a3-40a2-bd70-90f0a3034ea0" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:30 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155" returned: 0 in 0.294s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac61584-ed12-4903-879b-0466ba56d85b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f348318b-63a3-40a2-bd70-90f0a3034ea0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:30 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.316s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:21:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Deleted volume successfully.
Sep 25 15:21:30 devstack sudo[106772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.info
Sep 25 15:21:30 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b0fe116f-16a2-42f5-9793-5dc4c6979015 tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-e79e36c6-613c-4e1b-a726-87cf6bccac57-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:30 devstack sudo[106771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f348318b-63a3-40a2-bd70-90f0a3034ea0
Sep 25 15:21:30 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:30 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.info" returned: 0 in 0.313s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:30 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.info is being set with open permissions: ugo+rw
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:30 devstack sudo[106777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.info
Sep 25 15:21:30 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:30 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f348318b-63a3-40a2-bd70-90f0a3034ea0" returned: 0 in 0.436s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f348318b-63a3-40a2-bd70-90f0a3034ea0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:30 devstack sudo[106782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f348318b-63a3-40a2-bd70-90f0a3034ea0
Sep 25 15:21:30 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:30 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.info" returned: 0 in 0.277s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.406s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.374s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=373e04b1-5110-4ed2-89e6-cfe5c8d3a524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23655b82863c434c83d0ada112c146d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:24Z,use_quota=True,user_id='475c523bf51c42369b595c464c0532d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc485527-a21c-458e-b389-b67abd1faa5d),volume_type_id=dc485527-a21c-458e-b389-b67abd1faa5d)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Creating volume 373e04b1-5110-4ed2-89e6-cfe5c8d3a524 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:30 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:30 devstack sudo[106786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524 1073741824
Sep 25 15:21:30 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e63a5a55-0ee6-4f48-9814-ccff431df37e tempest-CreateVolumesFromSnapshotTest-1417980240 None] Create snapshot completed successfully
Sep 25 15:21:31 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-f348318b-63a3-40a2-bd70-90f0a3034ea0" returned: 0 in 0.266s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-quobyte-f348318b-63a3-40a2-bd70-90f0a3034ea0" released by "delete_volume" :: held 0.768s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Created reservations ['3ec5e168-aba8-477e-afef-8e3064373965', '7efe31e7-485c-48f5-ac52-ce5049b105a4', 'cd10181d-bb47-4201-bf68-2258c2f4aee9', 'e3509a9d-da4a-4844-8768-f34a58009835'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:31 devstack sudo[106788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:21:31 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "cinder-5b4b59f9-b78c-4419-908e-77508b048d70-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:31 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.315s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-5b4b59f9-b78c-4419-908e-77508b048d70-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Deleted volume successfully.
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3e05649c-90ff-4548-a0cc-d6d2c37e09df tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-f348318b-63a3-40a2-bd70-90f0a3034ea0-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:31 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524 1073741824" returned: 0 in 0.592s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "cinder-quobyte-5b4b59f9-b78c-4419-908e-77508b048d70" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-quobyte-5b4b59f9-b78c-4419-908e-77508b048d70" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fcd8dc-9653-45b8-b2bf-e2c7b588640c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b4b59f9-b78c-4419-908e-77508b048d70 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:31 devstack sudo[106796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524
Sep 25 15:21:31 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:31 devstack sudo[106795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b4b59f9-b78c-4419-908e-77508b048d70
Sep 25 15:21:31 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:31 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524" returned: 0 in 0.376s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.148s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Acquiring lock "cinder-quobyte-8c85ce23-02d3-4839-bcdc-888de2b42486-11e768de-e366-4f7d-8cb1-14240050f431" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Lock "cinder-quobyte-8c85ce23-02d3-4839-bcdc-888de2b42486-11e768de-e366-4f7d-8cb1-14240050f431" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Creating volume 11e768de-e366-4f7d-8cb1-14240050f431 from snapshot 8c85ce23-02d3-4839-bcdc-888de2b42486 {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Acquiring lock "cinder-quobyte-11e768de-e366-4f7d-8cb1-14240050f431" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Attempting download of 1bbb269c-3edf-432f-ab28-0843e65b3308 ((None, [{'url': 'file:///opt/stack/data/glance/images/1bbb269c-3edf-432f-ab28-0843e65b3308', 'metadata': {}}])) to volume 373e04b1-5110-4ed2-89e6-cfe5c8d3a524. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Lock "cinder-quobyte-11e768de-e366-4f7d-8cb1-14240050f431" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] snapshot: 8c85ce23-02d3-4839-bcdc-888de2b42486, volume: 11e768de-e366-4f7d-8cb1-14240050f431,  {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 15:21:32 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1b4362-98df-4f7d-85db-89e98a5252fe]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b4b59f9-b78c-4419-908e-77508b048d70" returned: 0 in 0.564s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b4b59f9-b78c-4419-908e-77508b048d70 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c557f0a3-cef0-4f4f-a296-a5e8132776d6]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bbb269c-3edf-432f-ab28-0843e65b3308_59t3xcu6 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:32 devstack sudo[106804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b4b59f9-b78c-4419-908e-77508b048d70
Sep 25 15:21:32 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Flow 'volume_create_manager' (ab7881e2-525e-4dfa-80b1-c08a8c95cc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363bdcdb-8978-4dc2-8b8b-cb51af39cb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363bdcdb-8978-4dc2-8b8b-cb51af39cb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037833555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c27ab967-67f9-4989-ab4c-08e2c45c7a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0ee6010e1f4fa5b7dd927f489aa468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:32Z,use_quota=True,user_id='9150ab29e86448d78f0f84a90d929d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743155be-8fbc-437f-9b5c-90507ba82f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743155be-8fbc-437f-9b5c-90507ba82f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd375959-b73d-4b6f-8741-5cb5f08a5d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd375959-b73d-4b6f-8741-5cb5f08a5d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c27ab967-67f9-4989-ab4c-08e2c45c7a99', 'volume_name': 'volume-c27ab967-67f9-4989-ab4c-08e2c45c7a99', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c205d7d2-1266-41d4-9644-d640586d9a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c205d7d2-1266-41d4-9644-d640586d9a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:32 devstack sudo[106805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bbb269c-3edf-432f-ab28-0843e65b3308_59t3xcu6
Sep 25 15:21:32 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e957f51f-f91d-4da7-a290-1ef23246da72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:32 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume c27ab967-67f9-4989-ab4c-08e2c45c7a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c27ab967-67f9-4989-ab4c-08e2c45c7a99', 'volume_size': 1}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:32 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486
Sep 25 15:21:32 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:32 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bbb269c-3edf-432f-ab28-0843e65b3308_59t3xcu6" returned: 0 in 0.496s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bbb269c-3edf-432f-ab28-0843e65b3308_59t3xcu6 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:32 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b4b59f9-b78c-4419-908e-77508b048d70" returned: 0 in 0.557s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-quobyte-5b4b59f9-b78c-4419-908e-77508b048d70" released by "delete_volume" :: held 1.219s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Flow 'volume_create_manager' (82549820-d032-4dc5-a3ca-894bb4d87f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4a2019-a8e5-499b-94f5-3130af10af81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:32 devstack sudo[106814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bbb269c-3edf-432f-ab28-0843e65b3308_59t3xcu6
Sep 25 15:21:32 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4a2019-a8e5-499b-94f5-3130af10af81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1381648790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b19006d-2903-4e47-abf0-697540202649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0ee6010e1f4fa5b7dd927f489aa468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:33Z,use_quota=True,user_id='9150ab29e86448d78f0f84a90d929d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:32 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394f362c-74bb-4134-9811-fd7be856f774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394f362c-74bb-4134-9811-fd7be856f774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e7eedac-48d3-4e00-921c-adfa2a7d06ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e7eedac-48d3-4e00-921c-adfa2a7d06ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b19006d-2903-4e47-abf0-697540202649', 'volume_name': 'volume-5b19006d-2903-4e47-abf0-697540202649', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908eb4f0-eec7-4da1-ad2a-741a674e18ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908eb4f0-eec7-4da1-ad2a-741a674e18ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2badcc1e-a1cd-4878-ad2a-b6df52dcbe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:32 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume 5b19006d-2903-4e47-abf0-697540202649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b19006d-2903-4e47-abf0-697540202649', 'volume_size': 1}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486" returned: 0 in 0.822s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Created reservations ['4730218f-f0f7-458a-9f54-8393432eca7f', '0e2a91a0-3572-4864-8e92-c4d7c72cc3ae', 'f6ad40c2-5e8a-4bc8-98bb-b44bf1e7d4b7', '184df85a-4574-4452-8e88-8b74537abf2c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2638b7c-7dd0-4b67-ab21-91a3387913b8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:33 devstack sudo[106820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:21:33 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:33 devstack sudo[106819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc
Sep 25 15:21:33 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:33 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bbb269c-3edf-432f-ab28-0843e65b3308_59t3xcu6" returned: 1 in 0.652s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bbb269c-3edf-432f-ab28-0843e65b3308_59t3xcu6' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d838bff1-e7ce-48c8-a486-a0bf8df4367c]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Flow 'volume_create_manager' (83569df2-9599-4ae2-866d-33951f0464dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (017018c3-c14e-43c6-8494-ca5b3a0dce2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (017018c3-c14e-43c6-8494-ca5b3a0dce2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1444212667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b840cc7a-2d9f-4b01-bd75-12764dd81048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0ee6010e1f4fa5b7dd927f489aa468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:33Z,use_quota=True,user_id='9150ab29e86448d78f0f84a90d929d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1320e0f-25e6-489b-8110-0e27496c0493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1320e0f-25e6-489b-8110-0e27496c0493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1470af7-bf2d-4a48-b754-0d5bd51dbf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:33 devstack sudo[106825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD
Sep 25 15:21:33 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1470af7-bf2d-4a48-b754-0d5bd51dbf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b840cc7a-2d9f-4b01-bd75-12764dd81048', 'volume_name': 'volume-b840cc7a-2d9f-4b01-bd75-12764dd81048', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99df7bdf-ba04-4ee3-a881-2f6bb587831e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99df7bdf-ba04-4ee3-a881-2f6bb587831e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096c6e9b-43b8-4f23-a9df-82410e195465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:33 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume b840cc7a-2d9f-4b01-bd75-12764dd81048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b840cc7a-2d9f-4b01-bd75-12764dd81048', 'volume_size': 1}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:33 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc" returned: 0 in 0.600s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Path /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11e768de-e366-4f7d-8cb1-14240050f431 not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11e768de-e366-4f7d-8cb1-14240050f431 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:33 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.498s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:21:33 devstack sudo[106831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11e768de-e366-4f7d-8cb1-14240050f431
Sep 25 15:21:33 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:33 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Deleted volume successfully.
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-074af114-1e81-46bc-9c41-014384089480 tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-5b4b59f9-b78c-4419-908e-77508b048d70-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "cinder-d9d62743-e2c3-4157-a3f5-500f0ca94df1-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:33 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD" returned: 0 in 0.511s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-d9d62743-e2c3-4157-a3f5-500f0ca94df1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "cinder-quobyte-d9d62743-e2c3-4157-a3f5-500f0ca94df1" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-quobyte-d9d62743-e2c3-4157-a3f5-500f0ca94df1" acquired by "delete_volume" :: waited 0.040s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:34 devstack sudo[106835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD
Sep 25 15:21:34 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Flow 'volume_create_manager' (71a25e25-b2fa-4475-8c11-2d5569ad35ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e69b12f-1bc2-44e6-9dc5-483f391e4717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3700b35-1019-4e9a-afbf-04f036ccc928]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d9d62743-e2c3-4157-a3f5-500f0ca94df1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e69b12f-1bc2-44e6-9dc5-483f391e4717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1953894993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67505a33-b008-4d64-a457-caf6d01dadba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0ee6010e1f4fa5b7dd927f489aa468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:34Z,use_quota=True,user_id='9150ab29e86448d78f0f84a90d929d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393c44e2-c458-4eb6-9ea3-13f304fe2eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393c44e2-c458-4eb6-9ea3-13f304fe2eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520dfb8a-d9d9-4729-956a-b9fd11be2010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520dfb8a-d9d9-4729-956a-b9fd11be2010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67505a33-b008-4d64-a457-caf6d01dadba', 'volume_name': 'volume-67505a33-b008-4d64-a457-caf6d01dadba', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca3e201-ce01-42d1-82ee-da1657e22d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca3e201-ce01-42d1-82ee-da1657e22d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b647b3-61c4-4b76-a1aa-132bfee0d53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:34 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume 67505a33-b008-4d64-a457-caf6d01dadba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67505a33-b008-4d64-a457-caf6d01dadba', 'volume_size': 1}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:34 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:34 devstack sudo[106841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d9d62743-e2c3-4157-a3f5-500f0ca94df1
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD" returned: 1 in 0.467s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] 1bbb269c-3edf-432f-ab28-0843e65b3308 was raw, converting to qcow2 {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 15:21:34 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:34 devstack sudo[106851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524
Sep 25 15:21:34 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:34 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:34 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Flow 'volume_create_manager' (e0d801f0-07ae-46a1-bce3-1057a177cea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d1ec02-585c-4fb9-a852-02cd12bfd045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d9d62743-e2c3-4157-a3f5-500f0ca94df1" returned: 0 in 0.877s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d9d62743-e2c3-4157-a3f5-500f0ca94df1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d1ec02-585c-4fb9-a852-02cd12bfd045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1746209653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fab371-2f90-4d31-9a37-5100822046d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0ee6010e1f4fa5b7dd927f489aa468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:35Z,use_quota=True,user_id='9150ab29e86448d78f0f84a90d929d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45986505-8def-4e0c-a899-437884c76b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45986505-8def-4e0c-a899-437884c76b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:35 devstack sudo[106860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d9d62743-e2c3-4157-a3f5-500f0ca94df1
Sep 25 15:21:35 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95adb52-a608-4d2a-a317-bcef3967338d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95adb52-a608-4d2a-a317-bcef3967338d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1fab371-2f90-4d31-9a37-5100822046d2', 'volume_name': 'volume-d1fab371-2f90-4d31-9a37-5100822046d2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007bbef7-ea32-4dfd-aec3-ff0b42aba2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007bbef7-ea32-4dfd-aec3-ff0b42aba2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3026ea50-9f99-43f9-9c73-26b5f3b331f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:35 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume d1fab371-2f90-4d31-9a37-5100822046d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1fab371-2f90-4d31-9a37-5100822046d2', 'volume_size': 1}
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:35 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d9d62743-e2c3-4157-a3f5-500f0ca94df1" returned: 0 in 0.607s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-quobyte-d9d62743-e2c3-4157-a3f5-500f0ca94df1" released by "delete_volume" :: held 1.633s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:35 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524" returned: 0 in 1.443s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1bbb269c-3edf-432f-ab28-0843e65b3308_2d97vdy6devstack@QuobyteHD, size 0.00 MB, duration 1.45 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:21:35 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Created reservations ['192a7a74-f90b-4419-b122-548605cec212', '89ad24d8-c495-46c8-b8e4-6bf90d335178', '13138491-4ecb-45f4-8a9f-47288950a806', '0aacae33-682e-461e-bfe8-ee92f87a2781'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:35 devstack sudo[106866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524 1G
Sep 25 15:21:35 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:35 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:36 devstack sudo[106868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:21:36 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:36 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.574s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:36 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:21:36 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524 1G" returned: 0 in 0.784s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:36 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Downloaded image 1bbb269c-3edf-432f-ab28-0843e65b3308 ((None, [{'url': 'file:///opt/stack/data/glance/images/1bbb269c-3edf-432f-ab28-0843e65b3308', 'metadata': {}}])) to volume 373e04b1-5110-4ed2-89e6-cfe5c8d3a524 successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 15:21:36 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Temporary image 1bbb269c-3edf-432f-ab28-0843e65b3308 for user 475c523bf51c42369b595c464c0532d7 is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 15:21:36 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Marking volume 373e04b1-5110-4ed2-89e6-cfe5c8d3a524 as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 15:21:36 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Deleted volume successfully.
Sep 25 15:21:36 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Copying metadata from image 1bbb269c-3edf-432f-ab28-0843e65b3308 to 373e04b1-5110-4ed2-89e6-cfe5c8d3a524. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 15:21:36 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Creating volume glance metadata for volume 373e04b1-5110-4ed2-89e6-cfe5c8d3a524 backed by image 1bbb269c-3edf-432f-ab28-0843e65b3308 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1bbb269c-3edf-432f-ab28-0843e65b3308', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0986059611456e99301f96b8e1bfc51b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 15:21:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-dd0af273-9a19-4925-9d77-63bb90fc3791 tempest-CreateVolumesFromImageTest-862127739 None] Lock "cinder-d9d62743-e2c3-4157-a3f5-500f0ca94df1-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6a4914-58dc-4e68-be00-5ade357542da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524', 'volume_size': 1, 'image_id': '1bbb269c-3edf-432f-ab28-0843e65b3308', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bbb269c-3edf-432f-ab28-0843e65b3308', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0986059611456e99301f96b8e1bfc51b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23655b82863c434c83d0ada112c146d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'abfaddf705a25b2992bc837cd02cc6362dd90715a98f9b8bbdc0e6f5e8c471b59e486e31f5bfc9d78f8af223bcaf0336c0326f99e6d25e79e70c49afe8f539ab', 'id': '1bbb269c-3edf-432f-ab28-0843e65b3308', 'created_at': datetime.datetime(2026, 9, 25, 13, 21, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 21, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bbb269c-3edf-432f-ab28-0843e65b3308/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7638263d1130>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6842cce8-e166-41d5-920d-97282ca90d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:36 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Volume volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524 (373e04b1-5110-4ed2-89e6-cfe5c8d3a524): created successfully
Sep 25 15:21:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6842cce8-e166-41d5-920d-97282ca90d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:36 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Flow 'volume_create_manager' (ca9f0503-0d7e-4096-a3ca-cab4568e784c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:36 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6175004d-68c2-4283-8d1c-f93ea7569a52 tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Created volume successfully.
Sep 25 15:21:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Acquiring lock "cinder-373e04b1-5110-4ed2-89e6-cfe5c8d3a524-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Lock "cinder-373e04b1-5110-4ed2-89e6-cfe5c8d3a524-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Acquiring lock "cinder-quobyte-373e04b1-5110-4ed2-89e6-cfe5c8d3a524" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Lock "cinder-quobyte-373e04b1-5110-4ed2-89e6-cfe5c8d3a524" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:37 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[03277d56-13d2-469b-98a1-306e5ec9307b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:38 devstack sudo[106875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524
Sep 25 15:21:38 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:38 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524" returned: 0 in 0.874s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:38 devstack sudo[106882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524
Sep 25 15:21:38 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:39 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-373e04b1-5110-4ed2-89e6-cfe5c8d3a524" returned: 0 in 0.454s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:39 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Lock "cinder-quobyte-373e04b1-5110-4ed2-89e6-cfe5c8d3a524" released by "delete_volume" :: held 1.447s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:39 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Created reservations ['f72fa2d5-0b88-4ba0-8277-d32c5580ddca', '30edd757-ac71-4ed4-8ad4-c596fda8a5da', '4e5be7d7-416a-4bb5-8e41-c797c62e584b', 'd72bc220-23d9-487b-9dda-6c24cb6fde23'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:39 devstack sudo[106885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:21:39 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:40 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.538s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:40 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:21:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Deleted volume successfully.
Sep 25 15:21:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-73d3ecbc-2784-4aab-9baa-72ab8aaf7bfe tempest-VolumeAndVolumeTypeFromImageTest-185573579 None] Lock "cinder-373e04b1-5110-4ed2-89e6-cfe5c8d3a524-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:42 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11e768de-e366-4f7d-8cb1-14240050f431" returned: 0 in 8.646s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Image conversion details: src /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc, size 1024.00 MB, duration 8.65 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11e768de-e366-4f7d-8cb1-14240050f431 {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:21:42 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Converted 1024.00 MB image at 118.42 MB/s
Sep 25 15:21:42 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11e768de-e366-4f7d-8cb1-14240050f431 is being set with open permissions: ugo+rw
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11e768de-e366-4f7d-8cb1-14240050f431 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:42 devstack sudo[106888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11e768de-e366-4f7d-8cb1-14240050f431
Sep 25 15:21:42 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:42 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11e768de-e366-4f7d-8cb1-14240050f431" returned: 0 in 0.334s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Lock "cinder-quobyte-11e768de-e366-4f7d-8cb1-14240050f431" released by "_copy_volume_from_snapshot" :: held 10.554s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Lock "cinder-quobyte-8c85ce23-02d3-4839-bcdc-888de2b42486-11e768de-e366-4f7d-8cb1-14240050f431" released by "_create_volume_from_snapshot" :: held 10.665s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.701s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.351s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037833555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c27ab967-67f9-4989-ab4c-08e2c45c7a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0ee6010e1f4fa5b7dd927f489aa468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:32Z,use_quota=True,user_id='9150ab29e86448d78f0f84a90d929d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Creating volume c27ab967-67f9-4989-ab4c-08e2c45c7a99 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:42 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c27ab967-67f9-4989-ab4c-08e2c45c7a99 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:42 devstack sudo[106891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c27ab967-67f9-4989-ab4c-08e2c45c7a99 1073741824
Sep 25 15:21:42 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96dc48f7-f6e6-453f-8861-307d1c5042fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e768de-e366-4f7d-8cb1-14240050f431', 'volume_size': 1, 'snapshot_id': '8c85ce23-02d3-4839-bcdc-888de2b42486'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0848b36c-4aac-4f6f-b820-8ea8da217e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Volume volume-11e768de-e366-4f7d-8cb1-14240050f431 (11e768de-e366-4f7d-8cb1-14240050f431): created successfully
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0848b36c-4aac-4f6f-b820-8ea8da217e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Flow 'volume_create_manager' (03b22b73-e619-416a-a38d-6a10b1e57567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f123c45f-1626-4361-8204-8c2f9826f068 tempest-VolumeDependencyTests-326416441 None] Created volume successfully.
Sep 25 15:21:43 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c27ab967-67f9-4989-ab4c-08e2c45c7a99 1073741824" returned: 0 in 0.577s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c27ab967-67f9-4989-ab4c-08e2c45c7a99 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:43 devstack sudo[106897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c27ab967-67f9-4989-ab4c-08e2c45c7a99
Sep 25 15:21:43 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Acquiring lock "cinder-8c85ce23-02d3-4839-bcdc-888de2b42486-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06eccea4-976c-4bea-a978-000871b023d2 tempest-ProjectAdminTests-1723674893 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.3550453186035, 'free_capacity_gb': 1775.3550453186035, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87071) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Lock "cinder-8c85ce23-02d3-4839-bcdc-888de2b42486-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Acquiring lock "cinder-quobyte-09a51daf-c85e-4f9e-8448-f45133b0cdbc" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Lock "cinder-quobyte-09a51daf-c85e-4f9e-8448-f45133b0cdbc" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Acquiring lock "cinder-quobyte-8c85ce23-02d3-4839-bcdc-888de2b42486" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Lock "cinder-quobyte-8c85ce23-02d3-4839-bcdc-888de2b42486" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Deleting offline snapshot 8c85ce23-02d3-4839-bcdc-888de2b42486 of volume 09a51daf-c85e-4f9e-8448-f45133b0cdbc {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] snapshot_file for this snap is: volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfe8187-b02f-4f1d-aac3-818fc0c4213e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:43 devstack sudo[106899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486
Sep 25 15:21:43 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:43 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c27ab967-67f9-4989-ab4c-08e2c45c7a99" returned: 0 in 0.423s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.801s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1381648790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b19006d-2903-4e47-abf0-697540202649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0ee6010e1f4fa5b7dd927f489aa468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:33Z,use_quota=True,user_id='9150ab29e86448d78f0f84a90d929d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Creating volume 5b19006d-2903-4e47-abf0-697540202649 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:43 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b19006d-2903-4e47-abf0-697540202649 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e957f51f-f91d-4da7-a290-1ef23246da72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c27ab967-67f9-4989-ab4c-08e2c45c7a99', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:43 devstack sudo[106902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b19006d-2903-4e47-abf0-697540202649 1073741824
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72fde31-2f4e-4eb1-ba49-b9e74478086d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:43 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:43 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume volume-c27ab967-67f9-4989-ab4c-08e2c45c7a99 (c27ab967-67f9-4989-ab4c-08e2c45c7a99): created successfully
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72fde31-2f4e-4eb1-ba49-b9e74478086d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:43 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Flow 'volume_create_manager' (ab7881e2-525e-4dfa-80b1-c08a8c95cc44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:43 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-71a54907-08cf-4dd8-9e07-3f575a2819a0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Created volume successfully.
Sep 25 15:21:44 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486" returned: 0 in 0.498s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1761072c-c5b4-48d4-8289-ecd33e741fa8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:44 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc
Sep 25 15:21:44 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:44 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b19006d-2903-4e47-abf0-697540202649 1073741824" returned: 0 in 0.599s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b19006d-2903-4e47-abf0-697540202649 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:44 devstack sudo[106914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b19006d-2903-4e47-abf0-697540202649
Sep 25 15:21:44 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:44 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b19006d-2903-4e47-abf0-697540202649" returned: 0 in 0.386s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.220s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1444212667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b840cc7a-2d9f-4b01-bd75-12764dd81048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0ee6010e1f4fa5b7dd927f489aa468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:33Z,use_quota=True,user_id='9150ab29e86448d78f0f84a90d929d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Creating volume b840cc7a-2d9f-4b01-bd75-12764dd81048 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:44 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b840cc7a-2d9f-4b01-bd75-12764dd81048 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:44 devstack sudo[106920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b840cc7a-2d9f-4b01-bd75-12764dd81048 1073741824
Sep 25 15:21:44 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:44 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2badcc1e-a1cd-4878-ad2a-b6df52dcbe91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b19006d-2903-4e47-abf0-697540202649', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a759ebc-780e-40aa-a04a-1b6fe35c9813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc" returned: 0 in 0.811s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:44 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume volume-5b19006d-2903-4e47-abf0-697540202649 (5b19006d-2903-4e47-abf0-697540202649): created successfully
Sep 25 15:21:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a759ebc-780e-40aa-a04a-1b6fe35c9813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:44 devstack sudo[106922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486
Sep 25 15:21:44 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Flow 'volume_create_manager' (82549820-d032-4dc5-a3ca-894bb4d87f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a9b53809-5f61-4dcd-8e10-5414c1ccc2e4 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Created volume successfully.
Sep 25 15:21:45 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486" returned: 0 in 0.491s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:45 devstack sudo[106931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486
Sep 25 15:21:45 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:45 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b840cc7a-2d9f-4b01-bd75-12764dd81048 1073741824" returned: 0 in 0.668s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b840cc7a-2d9f-4b01-bd75-12764dd81048 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:45 devstack sudo[106934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b840cc7a-2d9f-4b01-bd75-12764dd81048
Sep 25 15:21:45 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:45 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc.8c85ce23-02d3-4839-bcdc-888de2b42486" returned: 0 in 0.379s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Lock "cinder-quobyte-8c85ce23-02d3-4839-bcdc-888de2b42486" released by "_delete_snapshot" :: held 2.329s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Lock "cinder-quobyte-09a51daf-c85e-4f9e-8448-f45133b0cdbc" released by "delete_snapshot" :: held 2.373s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:45 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Created reservations ['1f3734b3-2e78-428a-9a85-801b6b6203da', 'efdf0c62-1ff6-426f-8604-2fd578c5508c', 'f497729a-fe54-4f9e-a80a-c70c0fae52f2', 'e230563e-dff1-4ea6-b17a-74abd9e5bc45'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:46 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b840cc7a-2d9f-4b01-bd75-12764dd81048" returned: 0 in 0.411s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.763s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1953894993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67505a33-b008-4d64-a457-caf6d01dadba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0ee6010e1f4fa5b7dd927f489aa468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:34Z,use_quota=True,user_id='9150ab29e86448d78f0f84a90d929d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Creating volume 67505a33-b008-4d64-a457-caf6d01dadba {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:46 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-67505a33-b008-4d64-a457-caf6d01dadba 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096c6e9b-43b8-4f23-a9df-82410e195465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b840cc7a-2d9f-4b01-bd75-12764dd81048', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:46 devstack sudo[106938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-67505a33-b008-4d64-a457-caf6d01dadba 1073741824
Sep 25 15:21:46 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c06f799-eaed-4940-8fd8-9313262f83d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:46 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume volume-b840cc7a-2d9f-4b01-bd75-12764dd81048 (b840cc7a-2d9f-4b01-bd75-12764dd81048): created successfully
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c06f799-eaed-4940-8fd8-9313262f83d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Flow 'volume_create_manager' (83569df2-9599-4ae2-866d-33951f0464dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-032c11d7-0881-44c7-90b9-10566409e9d0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Created volume successfully.
Sep 25 15:21:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Delete snapshot completed successfully.
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-85eef3e0-c339-48b1-bacd-879f1ff0bc2d tempest-VolumeDependencyTests-326416441 None] Lock "cinder-8c85ce23-02d3-4839-bcdc-888de2b42486-delete_snapshot" released by "delete_snapshot" :: held 2.731s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:46 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-67505a33-b008-4d64-a457-caf6d01dadba 1073741824" returned: 0 in 0.650s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Acquiring lock "cinder-09a51daf-c85e-4f9e-8448-f45133b0cdbc-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-67505a33-b008-4d64-a457-caf6d01dadba {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Lock "cinder-09a51daf-c85e-4f9e-8448-f45133b0cdbc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:46 devstack sudo[106944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-67505a33-b008-4d64-a457-caf6d01dadba
Sep 25 15:21:46 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Acquiring lock "cinder-quobyte-09a51daf-c85e-4f9e-8448-f45133b0cdbc" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Lock "cinder-quobyte-09a51daf-c85e-4f9e-8448-f45133b0cdbc" acquired by "delete_volume" :: waited 0.042s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff88032-4b33-47d6-a53d-9992ec571057]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:47 devstack sudo[106946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc
Sep 25 15:21:47 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Flow 'volume_create_manager' (3bbbb5f0-5ad5-44a7-8b8d-107be33058db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acd5bd95-65b3-4de3-aae2-6aa4b34a049c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:47 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-67505a33-b008-4d64-a457-caf6d01dadba" returned: 0 in 0.415s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1746209653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fab371-2f90-4d31-9a37-5100822046d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0ee6010e1f4fa5b7dd927f489aa468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:35Z,use_quota=True,user_id='9150ab29e86448d78f0f84a90d929d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Creating volume d1fab371-2f90-4d31-9a37-5100822046d2 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:47 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d1fab371-2f90-4d31-9a37-5100822046d2 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acd5bd95-65b3-4de3-aae2-6aa4b34a049c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada72e55-b472-44b5-b66b-55059d34f37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d731aee3126947a99906ccc203f7e08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:47Z,use_quota=True,user_id='fa754a5b02fa4f649d02b67099c3a33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61fab3f6-9a0b-4de4-b390-287b13c5ac65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61fab3f6-9a0b-4de4-b390-287b13c5ac65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:47 devstack sudo[106949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d1fab371-2f90-4d31-9a37-5100822046d2 1073741824
Sep 25 15:21:47 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ec92a3-bb12-4fbc-8c63-f295b46a73dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ec92a3-bb12-4fbc-8c63-f295b46a73dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada72e55-b472-44b5-b66b-55059d34f37c', 'volume_name': 'volume-ada72e55-b472-44b5-b66b-55059d34f37c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4244a1f9-60d9-484c-9ae5-12077d5543f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4244a1f9-60d9-484c-9ae5-12077d5543f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c656ae37-96e2-4d9f-93fd-cf8ee9d3e719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Volume ada72e55-b472-44b5-b66b-55059d34f37c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada72e55-b472-44b5-b66b-55059d34f37c', 'volume_size': 1}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b647b3-61c4-4b76-a1aa-132bfee0d53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67505a33-b008-4d64-a457-caf6d01dadba', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4bfc43-25ad-4a8e-8424-c809af5484d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume volume-67505a33-b008-4d64-a457-caf6d01dadba (67505a33-b008-4d64-a457-caf6d01dadba): created successfully
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4bfc43-25ad-4a8e-8424-c809af5484d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Flow 'volume_create_manager' (71a25e25-b2fa-4475-8c11-2d5569ad35ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=137,cinder:SELECT=100,cinder:INSERT=39,cinder:DELETE=14 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:21:47 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-96109fe8-8c08-418f-86f2-257482f9222c tempest-CreateVolumesFromSnapshotTest-1417980240 None] Created volume successfully.
Sep 25 15:21:47 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc" returned: 0 in 0.561s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:47 devstack sudo[106955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc
Sep 25 15:21:47 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:47 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:47 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-09a51daf-c85e-4f9e-8448-f45133b0cdbc" returned: 0 in 0.331s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d1fab371-2f90-4d31-9a37-5100822046d2 1073741824" returned: 0 in 0.671s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Lock "cinder-quobyte-09a51daf-c85e-4f9e-8448-f45133b0cdbc" released by "delete_volume" :: held 0.991s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d1fab371-2f90-4d31-9a37-5100822046d2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:47 devstack sudo[106962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d1fab371-2f90-4d31-9a37-5100822046d2
Sep 25 15:21:47 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:47 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Created reservations ['b6fbe254-d2ec-4736-b5ef-f1929c525f31', 'fc54f399-29b3-481a-b3b6-3cb0a4203539', '15a572a6-6630-4508-acda-e0ad517809ec', '99239de9-cdaf-4ccb-a947-f9c208563c95'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:48 devstack sudo[106965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:21:48 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:48 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d1fab371-2f90-4d31-9a37-5100822046d2" returned: 0 in 0.367s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.031s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada72e55-b472-44b5-b66b-55059d34f37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d731aee3126947a99906ccc203f7e08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:47Z,use_quota=True,user_id='fa754a5b02fa4f649d02b67099c3a33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Creating volume ada72e55-b472-44b5-b66b-55059d34f37c {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:48 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ada72e55-b472-44b5-b66b-55059d34f37c 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3026ea50-9f99-43f9-9c73-26b5f3b331f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1fab371-2f90-4d31-9a37-5100822046d2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:48 devstack sudo[106968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ada72e55-b472-44b5-b66b-55059d34f37c 1073741824
Sep 25 15:21:48 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b0ac4d-4f57-468a-a6ba-5cd67a9d1037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:48 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Volume volume-d1fab371-2f90-4d31-9a37-5100822046d2 (d1fab371-2f90-4d31-9a37-5100822046d2): created successfully
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b0ac4d-4f57-468a-a6ba-5cd67a9d1037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Flow 'volume_create_manager' (e0d801f0-07ae-46a1-bce3-1057a177cea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-59f7c3e8-4a31-4021-893c-74c12eb8c638 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Created volume successfully.
Sep 25 15:21:48 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.329s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:21:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Deleted volume successfully.
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5d0d0920-af0d-44f9-a8a8-69e8622241e1 tempest-VolumeDependencyTests-326416441 None] Lock "cinder-09a51daf-c85e-4f9e-8448-f45133b0cdbc-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "cinder-d1fab371-2f90-4d31-9a37-5100822046d2-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-d1fab371-2f90-4d31-9a37-5100822046d2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "cinder-quobyte-d1fab371-2f90-4d31-9a37-5100822046d2" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-quobyte-d1fab371-2f90-4d31-9a37-5100822046d2" acquired by "delete_volume" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c252e25-d361-4cd7-8bdb-67ec54e21f12]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d1fab371-2f90-4d31-9a37-5100822046d2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:48 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ada72e55-b472-44b5-b66b-55059d34f37c 1073741824" returned: 0 in 0.560s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ada72e55-b472-44b5-b66b-55059d34f37c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:48 devstack sudo[106976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ada72e55-b472-44b5-b66b-55059d34f37c
Sep 25 15:21:48 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:48 devstack sudo[106975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d1fab371-2f90-4d31-9a37-5100822046d2
Sep 25 15:21:48 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Acquiring lock "cinder-11e768de-e366-4f7d-8cb1-14240050f431-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Lock "cinder-11e768de-e366-4f7d-8cb1-14240050f431-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Acquiring lock "cinder-quobyte-11e768de-e366-4f7d-8cb1-14240050f431" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Lock "cinder-quobyte-11e768de-e366-4f7d-8cb1-14240050f431" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cd0a2d-f8e9-4f94-a181-90b19d9de3e8]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11e768de-e366-4f7d-8cb1-14240050f431 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:49 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ada72e55-b472-44b5-b66b-55059d34f37c" returned: 0 in 0.434s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c656ae37-96e2-4d9f-93fd-cf8ee9d3e719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada72e55-b472-44b5-b66b-55059d34f37c', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a3f577-5c8f-4c17-bd5b-04b0db5bdf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:49 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Volume volume-ada72e55-b472-44b5-b66b-55059d34f37c (ada72e55-b472-44b5-b66b-55059d34f37c): created successfully
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a3f577-5c8f-4c17-bd5b-04b0db5bdf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Flow 'volume_create_manager' (3bbbb5f0-5ad5-44a7-8b8d-107be33058db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:49 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e0277fa5-ce50-47ea-b430-ce50a8629cb9 tempest-CinderUnicodeTest-1980031203 None] Created volume successfully.
Sep 25 15:21:49 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d1fab371-2f90-4d31-9a37-5100822046d2" returned: 0 in 0.621s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d1fab371-2f90-4d31-9a37-5100822046d2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:49 devstack sudo[106981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11e768de-e366-4f7d-8cb1-14240050f431
Sep 25 15:21:49 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:49 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d1fab371-2f90-4d31-9a37-5100822046d2
Sep 25 15:21:49 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:49 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d1fab371-2f90-4d31-9a37-5100822046d2" returned: 0 in 0.352s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-quobyte-d1fab371-2f90-4d31-9a37-5100822046d2" released by "delete_volume" :: held 1.036s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:49 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11e768de-e366-4f7d-8cb1-14240050f431" returned: 0 in 0.567s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11e768de-e366-4f7d-8cb1-14240050f431 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:49 devstack sudo[106992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11e768de-e366-4f7d-8cb1-14240050f431
Sep 25 15:21:49 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:49 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Created reservations ['963be734-61a6-4d67-a26d-3b8d51e1b03e', '4d68018f-3778-4e0f-b71b-961f75a5ecbe', '6eccb9f2-6255-4528-865f-b07488d02c99', '91f8af3d-536f-4ac2-8b98-7191d27255db'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:50 devstack sudo[106994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:21:50 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:50 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-11e768de-e366-4f7d-8cb1-14240050f431" returned: 0 in 0.360s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Lock "cinder-quobyte-11e768de-e366-4f7d-8cb1-14240050f431" released by "delete_volume" :: held 0.994s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Created reservations ['cd94109c-309f-4cb9-8685-10a6a9b18618', '8ed936f5-653b-4999-b37a-a6b54c78638c', 'de4fde5b-9735-4d30-9dfa-2b2b711a333d', '821333b6-1d78-4f9c-8b80-417a3b70ac1c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:50 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.332s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:21:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Deleted volume successfully.
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f0b7af9f-95a9-4938-b94c-45f3414349ff tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-d1fab371-2f90-4d31-9a37-5100822046d2-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:50 devstack sudo[106999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:21:50 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:50 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.319s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:21:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Deleted volume successfully.
Sep 25 15:21:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3bc3e8d5-a104-405b-9309-f08397455945 tempest-VolumeDependencyTests-326416441 None] Lock "cinder-11e768de-e366-4f7d-8cb1-14240050f431-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "cinder-67505a33-b008-4d64-a457-caf6d01dadba-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-67505a33-b008-4d64-a457-caf6d01dadba-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Flow 'volume_create_manager' (1eeb8d95-72a1-440b-9ce2-ea33ceb25e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f0325b-7106-4380-b2b6-4e338d8d501f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f0325b-7106-4380-b2b6-4e338d8d501f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1081279555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7d1d48-d745-4eaf-a554-b7b232e0acc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d731aee3126947a99906ccc203f7e08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:51Z,use_quota=True,user_id='fa754a5b02fa4f649d02b67099c3a33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc233bc-d144-4e85-b58d-972e305fb23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc233bc-d144-4e85-b58d-972e305fb23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf91f32-3ff8-4216-b764-cb1764f30be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf91f32-3ff8-4216-b764-cb1764f30be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e7d1d48-d745-4eaf-a554-b7b232e0acc1', 'volume_name': 'volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42619466-869e-441e-8915-d7de3dfab367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42619466-869e-441e-8915-d7de3dfab367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45d6d3f-a8fb-4f4f-b737-d0f855628253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:51 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Volume 2e7d1d48-d745-4eaf-a554-b7b232e0acc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1', 'volume_size': 1}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:21:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1081279555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7d1d48-d745-4eaf-a554-b7b232e0acc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d731aee3126947a99906ccc203f7e08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:21:51Z,use_quota=True,user_id='fa754a5b02fa4f649d02b67099c3a33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Creating volume 2e7d1d48-d745-4eaf-a554-b7b232e0acc1 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:21:51 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "cinder-quobyte-67505a33-b008-4d64-a457-caf6d01dadba" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:51 devstack sudo[107002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1 1073741824
Sep 25 15:21:51 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-quobyte-67505a33-b008-4d64-a457-caf6d01dadba" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae63ce2-febd-4ada-b496-6b97cac67c36]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-67505a33-b008-4d64-a457-caf6d01dadba {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:51 devstack sudo[107004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-67505a33-b008-4d64-a457-caf6d01dadba
Sep 25 15:21:51 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:51 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-67505a33-b008-4d64-a457-caf6d01dadba" returned: 0 in 0.395s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-67505a33-b008-4d64-a457-caf6d01dadba {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:51 devstack sudo[107013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-67505a33-b008-4d64-a457-caf6d01dadba
Sep 25 15:21:51 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:51 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1 1073741824" returned: 0 in 0.575s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:51 devstack sudo[107015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1
Sep 25 15:21:51 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:51 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-67505a33-b008-4d64-a457-caf6d01dadba" returned: 0 in 0.322s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-quobyte-67505a33-b008-4d64-a457-caf6d01dadba" released by "delete_volume" :: held 0.772s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Created reservations ['0d4b7e51-b028-432f-957d-7428ad2ad4cf', '8b7196a6-e1b5-41c0-8c7f-e37fe62213df', 'c818715f-6925-4d8f-aab0-65f5a07ab4d9', 'a9405c23-14d8-492c-a38c-071edd41c1f9'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:52 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1" returned: 0 in 0.377s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45d6d3f-a8fb-4f4f-b737-d0f855628253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:52 devstack sudo[107019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:21:52 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8df9beb-b131-46d2-b807-62bdf2bd8b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:21:52 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Volume volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1 (2e7d1d48-d745-4eaf-a554-b7b232e0acc1): created successfully
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8df9beb-b131-46d2-b807-62bdf2bd8b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Flow 'volume_create_manager' (1eeb8d95-72a1-440b-9ce2-ea33ceb25e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:21:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-14832ef2-e088-4d6c-91b7-0070417c63e1 tempest-CinderUnicodeTest-1980031203 None] Created volume successfully.
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "cinder-b840cc7a-2d9f-4b01-bd75-12764dd81048-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-b840cc7a-2d9f-4b01-bd75-12764dd81048-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "cinder-quobyte-b840cc7a-2d9f-4b01-bd75-12764dd81048" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-quobyte-b840cc7a-2d9f-4b01-bd75-12764dd81048" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a252e1c0-0f4e-41b7-a8db-3620af4f2b24]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b840cc7a-2d9f-4b01-bd75-12764dd81048 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:52 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.384s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:21:52 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Deleted volume successfully.
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-db8c53b9-8ec6-4fca-8a7e-4edb8cfd56c0 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-67505a33-b008-4d64-a457-caf6d01dadba-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:52 devstack sudo[107022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b840cc7a-2d9f-4b01-bd75-12764dd81048
Sep 25 15:21:52 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:52 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b840cc7a-2d9f-4b01-bd75-12764dd81048" returned: 0 in 0.506s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b840cc7a-2d9f-4b01-bd75-12764dd81048 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:53 devstack sudo[107029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b840cc7a-2d9f-4b01-bd75-12764dd81048
Sep 25 15:21:53 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:53 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b840cc7a-2d9f-4b01-bd75-12764dd81048" returned: 0 in 0.276s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-quobyte-b840cc7a-2d9f-4b01-bd75-12764dd81048" released by "delete_volume" :: held 0.851s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Created reservations ['b3984ab9-40f7-44c8-9e86-a54a7bf07777', '43362585-413d-435a-be3e-4116e36ca5c6', 'e704c83e-e705-4344-8eee-baf44bc8afa9', 'ab6ca727-f7c2-4f7e-81e2-5103f97f45d0'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:53 devstack sudo[107032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:21:53 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "cinder-5b19006d-2903-4e47-abf0-697540202649-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] Creating offline snapshot d11c0082-207b-4fce-b381-8ddcb47e434e of volume 2e7d1d48-d745-4eaf-a554-b7b232e0acc1 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-5b19006d-2903-4e47-abf0-697540202649-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e345506b-bc1f-4f65-9277-e95b8f87ebb7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "cinder-quobyte-5b19006d-2903-4e47-abf0-697540202649" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-quobyte-5b19006d-2903-4e47-abf0-697540202649" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e32345b-bc83-45a5-98bf-10478054384c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b19006d-2903-4e47-abf0-697540202649 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:53 devstack sudo[107034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1
Sep 25 15:21:53 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:53 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.364s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:21:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Deleted volume successfully.
Sep 25 15:21:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-50adb07e-acc8-4dca-ac1e-6292ddc755a2 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-b840cc7a-2d9f-4b01-bd75-12764dd81048-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:54 devstack sudo[107036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b19006d-2903-4e47-abf0-697540202649
Sep 25 15:21:54 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:54 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1" returned: 0 in 0.541s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:54 devstack sudo[107044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e 1G
Sep 25 15:21:54 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:54 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b19006d-2903-4e47-abf0-697540202649" returned: 0 in 0.530s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b19006d-2903-4e47-abf0-697540202649 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:54 devstack sudo[107047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b19006d-2903-4e47-abf0-697540202649
Sep 25 15:21:54 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:54 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5b19006d-2903-4e47-abf0-697540202649" returned: 0 in 0.372s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-quobyte-5b19006d-2903-4e47-abf0-697540202649" released by "delete_volume" :: held 0.979s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:54 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Created reservations ['d6685f4c-06fe-47e2-9f16-4fd5abd57913', '0e6fc35f-dbaf-4f68-9b5d-0a68104aa0be', '4e24e3cd-51e3-47ad-b6f7-69f1a803dee4', 'ca0089bd-f917-4927-a2a7-af5f7ab2e754'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:54 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e 1G" returned: 0 in 0.634s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:54 devstack sudo[107054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e
Sep 25 15:21:54 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:54 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:55 devstack sudo[107056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:21:55 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:55 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e" returned: 0 in 0.389s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:55 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e is being set with open permissions: ugo+rw
Sep 25 15:21:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:55 devstack sudo[107063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e
Sep 25 15:21:55 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:55 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.374s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:55 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:21:55 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Deleted volume successfully.
Sep 25 15:21:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-65323ff4-d9ea-415f-ab80-0a6453947d28 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-5b19006d-2903-4e47-abf0-697540202649-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:55 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e" returned: 0 in 0.300s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:55 devstack sudo[107069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.info
Sep 25 15:21:55 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:55 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.info" returned: 0 in 0.325s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:55 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.info is being set with open permissions: ugo+rw
Sep 25 15:21:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:55 devstack sudo[107075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.info
Sep 25 15:21:55 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "cinder-c27ab967-67f9-4989-ab4c-08e2c45c7a99-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-c27ab967-67f9-4989-ab4c-08e2c45c7a99-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "cinder-quobyte-c27ab967-67f9-4989-ab4c-08e2c45c7a99" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-quobyte-c27ab967-67f9-4989-ab4c-08e2c45c7a99" acquired by "delete_volume" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[64860bc8-f1ee-4421-b460-e3adabbf6601]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c27ab967-67f9-4989-ab4c-08e2c45c7a99 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:56 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.info" returned: 0 in 0.374s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.726s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:56 devstack sudo[107077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c27ab967-67f9-4989-ab4c-08e2c45c7a99
Sep 25 15:21:56 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b50ee818-3050-4968-b372-527266ae5b6a tempest-CinderUnicodeTest-1980031203 None] Create snapshot completed successfully
Sep 25 15:21:56 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c27ab967-67f9-4989-ab4c-08e2c45c7a99" returned: 0 in 0.529s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c27ab967-67f9-4989-ab4c-08e2c45c7a99 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:56 devstack sudo[107084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c27ab967-67f9-4989-ab4c-08e2c45c7a99
Sep 25 15:21:56 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Acquiring lock "cinder-d11c0082-207b-4fce-b381-8ddcb47e434e-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Lock "cinder-d11c0082-207b-4fce-b381-8ddcb47e434e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Acquiring lock "cinder-quobyte-2e7d1d48-d745-4eaf-a554-b7b232e0acc1" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Lock "cinder-quobyte-2e7d1d48-d745-4eaf-a554-b7b232e0acc1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Acquiring lock "cinder-quobyte-d11c0082-207b-4fce-b381-8ddcb47e434e" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Lock "cinder-quobyte-d11c0082-207b-4fce-b381-8ddcb47e434e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Deleting offline snapshot d11c0082-207b-4fce-b381-8ddcb47e434e of volume 2e7d1d48-d745-4eaf-a554-b7b232e0acc1 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] snapshot_file for this snap is: volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc68ffd-9b71-49c5-8ce8-72f48fc1ffa4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:57 devstack sudo[107086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e
Sep 25 15:21:57 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:57 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c27ab967-67f9-4989-ab4c-08e2c45c7a99" returned: 0 in 0.353s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-quobyte-c27ab967-67f9-4989-ab4c-08e2c45c7a99" released by "delete_volume" :: held 0.971s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:57 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Created reservations ['108554f4-b2dc-4ab7-ba85-faa24bb0ffbc', 'e6e611ec-5f6c-4f76-8024-4e1db0278b0f', '55bc7a7f-e7c6-407e-92f9-e540b3df1cb9', '0cdd08c0-26cc-4aa7-abd4-d24c0d0223e2'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:21:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:21:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:21:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:21:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:21:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:57 devstack sudo[107091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:21:57 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:57 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e" returned: 0 in 0.587s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:21:57 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6a24bc-a691-4d41-a031-26960e90a8b0]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:57 devstack sudo[107095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1
Sep 25 15:21:57 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:57 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.367s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:57 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:21:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Deleted volume successfully.
Sep 25 15:21:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-6cfc05ea-b708-43a0-bc9f-00f0e6b31c29 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-c27ab967-67f9-4989-ab4c-08e2c45c7a99-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:58 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1" returned: 0 in 0.553s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:58 devstack sudo[107102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e
Sep 25 15:21:58 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "cinder-0641bc0b-0b86-4b55-bdbe-4817e1321155-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-0641bc0b-0b86-4b55-bdbe-4817e1321155-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "cinder-quobyte-c0b0632d-e6df-45c4-822c-2482f6a997bd" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-quobyte-c0b0632d-e6df-45c4-822c-2482f6a997bd" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "cinder-quobyte-0641bc0b-0b86-4b55-bdbe-4817e1321155" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-quobyte-0641bc0b-0b86-4b55-bdbe-4817e1321155" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Deleting offline snapshot 0641bc0b-0b86-4b55-bdbe-4817e1321155 of volume c0b0632d-e6df-45c4-822c-2482f6a997bd {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] snapshot_file for this snap is: volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da94ee6-b6a2-4436-ad74-7f136a47aa01]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:58 devstack sudo[107107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155
Sep 25 15:21:58 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:58 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e" returned: 0 in 0.500s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:58 devstack sudo[107109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e
Sep 25 15:21:58 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:58 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155" returned: 0 in 0.474s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0b0632d-e6df-45c4-822c-2482f6a997bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:21:58 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1.d11c0082-207b-4fce-b381-8ddcb47e434e" returned: 0 in 0.352s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:59 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[884481cd-656d-4b6c-a9fe-a7244832670e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:21:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Lock "cinder-quobyte-d11c0082-207b-4fce-b381-8ddcb47e434e" released by "_delete_snapshot" :: held 2.213s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Lock "cinder-quobyte-2e7d1d48-d745-4eaf-a554-b7b232e0acc1" released by "delete_snapshot" :: held 2.248s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:59 devstack sudo[107116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd
Sep 25 15:21:59 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:21:59 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Created reservations ['7f6a50f2-8d63-4b5b-a1f0-86f223e76b2b', 'efc847c4-4c96-46ad-a7b3-11d4431ec243', '54945598-33f8-4031-a74c-2c45955e5529', '41c46c03-7bfb-4c5d-8a4d-f36955be9233'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:21:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Delete snapshot completed successfully.
Sep 25 15:21:59 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-02355013-1c91-4cf3-b5be-a1675f6d3e7c tempest-CinderUnicodeTest-1980031203 None] Lock "cinder-d11c0082-207b-4fce-b381-8ddcb47e434e-delete_snapshot" released by "delete_snapshot" :: held 2.527s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:21:59 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root
Sep 25 15:21:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd" returned: 0 in 0.576s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:21:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:21:59 devstack sudo[107121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155
Sep 25 15:21:59 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:00 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155" returned: 0 in 0.466s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:00 devstack sudo[107127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155
Sep 25 15:22:00 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Acquiring lock "cinder-2e7d1d48-d745-4eaf-a554-b7b232e0acc1-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Lock "cinder-2e7d1d48-d745-4eaf-a554-b7b232e0acc1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Acquiring lock "cinder-quobyte-2e7d1d48-d745-4eaf-a554-b7b232e0acc1" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Lock "cinder-quobyte-2e7d1d48-d745-4eaf-a554-b7b232e0acc1" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:00 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[03853f5a-21ac-40cb-a4cd-5b4b31983a5a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:00 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd.0641bc0b-0b86-4b55-bdbe-4817e1321155" returned: 0 in 0.405s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:00 devstack sudo[107129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1
Sep 25 15:22:00 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-quobyte-0641bc0b-0b86-4b55-bdbe-4817e1321155" released by "_delete_snapshot" :: held 2.109s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-quobyte-c0b0632d-e6df-45c4-822c-2482f6a997bd" released by "delete_snapshot" :: held 2.145s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:00 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Created reservations ['5012f4d9-2ad1-4fa3-b0ab-897672e43c7e', '9185b524-2070-4310-adfe-9042f2a46883', 'd53b72c9-ad84-4967-9790-7690410b281e', '6ef28a69-3c2a-4c5f-add0-2d1a5263a2e6'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Delete snapshot completed successfully.
Sep 25 15:22:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ca6a5802-571a-494c-862e-ba5cae2a9b79 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-0641bc0b-0b86-4b55-bdbe-4817e1321155-delete_snapshot" released by "delete_snapshot" :: held 2.406s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:00 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1" returned: 0 in 0.553s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:00 devstack sudo[107135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1
Sep 25 15:22:00 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:01 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-2e7d1d48-d745-4eaf-a554-b7b232e0acc1" returned: 0 in 0.279s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Lock "cinder-quobyte-2e7d1d48-d745-4eaf-a554-b7b232e0acc1" released by "delete_volume" :: held 0.938s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Created reservations ['5ef52762-296e-4904-8ae6-3da35bd1cfe1', 'acea6ff3-830c-4135-a37c-b27ce0454415', '9a682967-d2e3-480e-b4ba-f70e3ab79213', 'c5546c4f-442c-476c-8c53-4d1c2a11ff68'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:01 devstack sudo[107138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:01 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "cinder-c0b0632d-e6df-45c4-822c-2482f6a997bd-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:01 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.318s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-c0b0632d-e6df-45c4-822c-2482f6a997bd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:01 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Deleted volume successfully.
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-aa202832-0260-41f7-9387-617c48c3b11d tempest-CinderUnicodeTest-1980031203 None] Lock "cinder-2e7d1d48-d745-4eaf-a554-b7b232e0acc1-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "cinder-quobyte-c0b0632d-e6df-45c4-822c-2482f6a997bd" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-quobyte-c0b0632d-e6df-45c4-822c-2482f6a997bd" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0b2b1d-7724-4970-87b1-41392c53e6df]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:01 devstack sudo[107141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd
Sep 25 15:22:01 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:02 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd" returned: 0 in 0.483s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:02 devstack sudo[107146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd
Sep 25 15:22:02 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Acquiring lock "cinder-ada72e55-b472-44b5-b66b-55059d34f37c-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Lock "cinder-ada72e55-b472-44b5-b66b-55059d34f37c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Acquiring lock "cinder-quobyte-ada72e55-b472-44b5-b66b-55059d34f37c" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Lock "cinder-quobyte-ada72e55-b472-44b5-b66b-55059d34f37c" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:02 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[650adb1c-4499-4f8c-b95e-af7bce77639a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ada72e55-b472-44b5-b66b-55059d34f37c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:02 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-c0b0632d-e6df-45c4-822c-2482f6a997bd" returned: 0 in 0.415s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-quobyte-c0b0632d-e6df-45c4-822c-2482f6a997bd" released by "delete_volume" :: held 0.991s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:02 devstack sudo[107148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ada72e55-b472-44b5-b66b-55059d34f37c
Sep 25 15:22:02 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:02 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Created reservations ['f1bdc2bf-9b55-4468-bdce-77152e434009', '7437de47-4e08-47f5-a8e7-e91f19d79c6a', '8a2a4d11-4132-4eba-9594-4fe249aa6ad0', 'b4781b9c-12e5-4f91-ad75-59a4d1acb6fe'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:03 devstack sudo[107153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:03 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:03 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ada72e55-b472-44b5-b66b-55059d34f37c" returned: 0 in 0.488s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ada72e55-b472-44b5-b66b-55059d34f37c {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:03 devstack sudo[107156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ada72e55-b472-44b5-b66b-55059d34f37c
Sep 25 15:22:03 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:03 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.401s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Deleted volume successfully.
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-80a8f7dc-0b6d-4c5b-ad57-5eb4f91d7b42 tempest-CreateVolumesFromSnapshotTest-1417980240 None] Lock "cinder-c0b0632d-e6df-45c4-822c-2482f6a997bd-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:03 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ada72e55-b472-44b5-b66b-55059d34f37c" returned: 0 in 0.378s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Lock "cinder-quobyte-ada72e55-b472-44b5-b66b-55059d34f37c" released by "delete_volume" :: held 0.939s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Flow 'volume_create_manager' (235c7b93-a260-4b4e-9821-2fb818ed2902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693b91ec-1a63-4167-9f43-01ec1d596d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693b91ec-1a63-4167-9f43-01ec1d596d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-121629761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453764c9-82b0-4306-913b-5d0357a2bee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06322166606245ae9d97610679e2ce30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:04Z,use_quota=True,user_id='9de10c7c009846479fbca2cb58cc032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ad8318-cafb-4570-babd-84b21e55b088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ad8318-cafb-4570-babd-84b21e55b088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4cacba2-c2d9-4c34-b501-442a1f67175d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4cacba2-c2d9-4c34-b501-442a1f67175d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '453764c9-82b0-4306-913b-5d0357a2bee2', 'volume_name': 'volume-453764c9-82b0-4306-913b-5d0357a2bee2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500dd70b-69af-470b-ba9b-057ebc96a60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500dd70b-69af-470b-ba9b-057ebc96a60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eebc516-2fe6-4e5e-bbe8-5d8357cd3627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:03 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Volume 453764c9-82b0-4306-913b-5d0357a2bee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-453764c9-82b0-4306-913b-5d0357a2bee2', 'volume_size': 1}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-121629761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453764c9-82b0-4306-913b-5d0357a2bee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06322166606245ae9d97610679e2ce30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:04Z,use_quota=True,user_id='9de10c7c009846479fbca2cb58cc032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Creating volume 453764c9-82b0-4306-913b-5d0357a2bee2 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:03 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:03 devstack sudo[107160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2 1073741824
Sep 25 15:22:03 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Created reservations ['fba5701b-b95f-4107-88e3-4ca8a4c22aa1', 'b629678e-40c3-40a2-a5d6-bf1b593a87ab', 'f0128357-48da-4274-b8dc-a518edc189a4', '4a5196f7-9cdb-4df3-9fe3-9edbfc9b93b4'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:03 devstack sudo[107162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:03 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:04 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.315s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:04 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:04 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Deleted volume successfully.
Sep 25 15:22:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b3711187-04cd-477b-b388-6b826b4ad893 tempest-CinderUnicodeTest-1980031203 None] Lock "cinder-ada72e55-b472-44b5-b66b-55059d34f37c-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:04 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2 1073741824" returned: 0 in 0.576s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:04 devstack sudo[107169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2
Sep 25 15:22:04 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:04 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2" returned: 0 in 0.386s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:04 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:22:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eebc516-2fe6-4e5e-bbe8-5d8357cd3627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-453764c9-82b0-4306-913b-5d0357a2bee2', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce80695-10d4-4086-8e6c-2d798dec4458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:04 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Volume volume-453764c9-82b0-4306-913b-5d0357a2bee2 (453764c9-82b0-4306-913b-5d0357a2bee2): created successfully
Sep 25 15:22:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce80695-10d4-4086-8e6c-2d798dec4458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:04 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Flow 'volume_create_manager' (235c7b93-a260-4b4e-9821-2fb818ed2902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:04 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-fad4d935-b4fe-4a5c-81e0-acca24983689 tempest-ProjectReaderTests-21771653 None] Created volume successfully.
Sep 25 15:22:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] Creating offline snapshot 9ae33aec-8dfa-43db-b822-f113147ddb82 of volume 453764c9-82b0-4306-913b-5d0357a2bee2 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:22:06 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9242e435-f4cf-40d0-a7e7-1316f3f11863]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:06 devstack sudo[107172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2
Sep 25 15:22:06 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:06 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2" returned: 0 in 0.468s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:06 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82 1G
Sep 25 15:22:06 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:07 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82 1G" returned: 0 in 0.452s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-453764c9-82b0-4306-913b-5d0357a2bee2 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:07 devstack sudo[107183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-453764c9-82b0-4306-913b-5d0357a2bee2 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82
Sep 25 15:22:07 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:07 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-453764c9-82b0-4306-913b-5d0357a2bee2 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82" returned: 0 in 0.463s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:07 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82 is being set with open permissions: ugo+rw
Sep 25 15:22:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:07 devstack sudo[107188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82
Sep 25 15:22:07 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:07 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82" returned: 0 in 0.431s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:08 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.info
Sep 25 15:22:08 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:08 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.info" returned: 0 in 0.466s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:08 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.info is being set with open permissions: ugo+rw
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:08 devstack sudo[107195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.info
Sep 25 15:22:08 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Flow 'volume_create_manager' (0e451126-cecf-46a9-88cd-bf85efdd9e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f5a9c4-36c8-4b56-a1ce-48668d512333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f5a9c4-36c8-4b56-a1ce-48668d512333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1208842624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6486490a-e5b8-47a3-80e1-818dc6402adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd00f5586b2042239c160db84830928e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:09Z,use_quota=True,user_id='d9987053abe74e73aa39016a41f06410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae02b41b-67e7-4385-9a66-92cb90477225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae02b41b-67e7-4385-9a66-92cb90477225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78007525-17d1-4f0c-8757-1b292001812a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78007525-17d1-4f0c-8757-1b292001812a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6486490a-e5b8-47a3-80e1-818dc6402adc', 'volume_name': 'volume-6486490a-e5b8-47a3-80e1-818dc6402adc', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2fcf912-59d4-4bba-859d-88d0b73930c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2fcf912-59d4-4bba-859d-88d0b73930c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faac62aa-a8ba-476a-8ae1-fa87ed5ae1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:08 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume 6486490a-e5b8-47a3-80e1-818dc6402adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6486490a-e5b8-47a3-80e1-818dc6402adc', 'volume_size': 1}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:08 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.info" returned: 0 in 0.335s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.773s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.098s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1208842624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6486490a-e5b8-47a3-80e1-818dc6402adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd00f5586b2042239c160db84830928e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:09Z,use_quota=True,user_id='d9987053abe74e73aa39016a41f06410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Creating volume 6486490a-e5b8-47a3-80e1-818dc6402adc {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:08 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6486490a-e5b8-47a3-80e1-818dc6402adc 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:08 devstack sudo[107198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6486490a-e5b8-47a3-80e1-818dc6402adc 1073741824
Sep 25 15:22:08 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b2ccbd7f-536e-46f9-91ef-7a2a0d8cc5c6 tempest-ProjectReaderTests-21771653 None] Create snapshot completed successfully
Sep 25 15:22:09 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6486490a-e5b8-47a3-80e1-818dc6402adc 1073741824" returned: 0 in 0.609s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6486490a-e5b8-47a3-80e1-818dc6402adc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:09 devstack sudo[107204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6486490a-e5b8-47a3-80e1-818dc6402adc
Sep 25 15:22:09 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-9ae33aec-8dfa-43db-b822-f113147ddb82-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Lock "cinder-9ae33aec-8dfa-43db-b822-f113147ddb82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-quobyte-453764c9-82b0-4306-913b-5d0357a2bee2" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-453764c9-82b0-4306-913b-5d0357a2bee2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-quobyte-9ae33aec-8dfa-43db-b822-f113147ddb82" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-9ae33aec-8dfa-43db-b822-f113147ddb82" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Deleting offline snapshot 9ae33aec-8dfa-43db-b822-f113147ddb82 of volume 453764c9-82b0-4306-913b-5d0357a2bee2 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:22:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] snapshot_file for this snap is: volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:22:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fd04cf-fac5-4719-b74d-44d8953ebf32]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:10 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6486490a-e5b8-47a3-80e1-818dc6402adc" returned: 0 in 0.451s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:22:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:10 devstack sudo[107206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82
Sep 25 15:22:10 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faac62aa-a8ba-476a-8ae1-fa87ed5ae1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6486490a-e5b8-47a3-80e1-818dc6402adc', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee49de04-515a-4ce0-9778-f19ac7adbac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:10 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume volume-6486490a-e5b8-47a3-80e1-818dc6402adc (6486490a-e5b8-47a3-80e1-818dc6402adc): created successfully
Sep 25 15:22:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee49de04-515a-4ce0-9778-f19ac7adbac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:10 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Flow 'volume_create_manager' (0e451126-cecf-46a9-88cd-bf85efdd9e60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:10 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-dfc3878b-dc3c-47ee-b4c2-fa40bf40b01c tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Created volume successfully.
Sep 25 15:22:10 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82" returned: 0 in 0.536s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:10 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-453764c9-82b0-4306-913b-5d0357a2bee2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:22:10 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[718e5a64-874c-438f-97b2-faaddb381c46]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:10 devstack sudo[107212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2
Sep 25 15:22:10 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:10 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2" returned: 0 in 0.489s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:11 devstack sudo[107218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82
Sep 25 15:22:11 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:11 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82" returned: 0 in 0.558s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:11 devstack sudo[107223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82
Sep 25 15:22:11 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:11 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2.9ae33aec-8dfa-43db-b822-f113147ddb82" returned: 0 in 0.422s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-9ae33aec-8dfa-43db-b822-f113147ddb82" released by "_delete_snapshot" :: held 2.242s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Flow 'volume_create_manager' (d2b225ad-668c-4e24-a072-689ea999083e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914cf2b4-712c-41a2-ad03-1016ece58db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-453764c9-82b0-4306-913b-5d0357a2bee2" released by "delete_snapshot" :: held 2.355s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914cf2b4-712c-41a2-ad03-1016ece58db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1289090441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3451b7-7446-4679-9982-ed02a951e048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd00f5586b2042239c160db84830928e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:12Z,use_quota=True,user_id='d9987053abe74e73aa39016a41f06410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b49bcc-e89e-4e48-b30e-50cfe41a13fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b49bcc-e89e-4e48-b30e-50cfe41a13fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef14932c-1624-42a4-b130-14f7ccd62dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef14932c-1624-42a4-b130-14f7ccd62dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d3451b7-7446-4679-9982-ed02a951e048', 'volume_name': 'volume-3d3451b7-7446-4679-9982-ed02a951e048', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c9c095-a58d-46a3-bede-d8cb8392e466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c9c095-a58d-46a3-bede-d8cb8392e466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15caa316-077f-4912-be61-768185d6cae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:12 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume 3d3451b7-7446-4679-9982-ed02a951e048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d3451b7-7446-4679-9982-ed02a951e048', 'volume_size': 1}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1289090441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3451b7-7446-4679-9982-ed02a951e048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd00f5586b2042239c160db84830928e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:12Z,use_quota=True,user_id='d9987053abe74e73aa39016a41f06410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Creating volume 3d3451b7-7446-4679-9982-ed02a951e048 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:12 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3d3451b7-7446-4679-9982-ed02a951e048 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:12 devstack sudo[107227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3d3451b7-7446-4679-9982-ed02a951e048 1073741824
Sep 25 15:22:12 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Flow 'volume_create_manager' (073b074f-b052-40e2-9c3f-19eabbf6424d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f8729c-bb57-4dbc-83ae-127d43b1d0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f8729c-bb57-4dbc-83ae-127d43b1d0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1760659249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca08efc-0617-41fe-ac11-50503739f2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd00f5586b2042239c160db84830928e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:12Z,use_quota=True,user_id='d9987053abe74e73aa39016a41f06410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6192dc7-a628-4695-b11c-6fda3a85454c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6192dc7-a628-4695-b11c-6fda3a85454c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d9bad1-c469-4013-9e8b-df6e50320e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d9bad1-c469-4013-9e8b-df6e50320e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eca08efc-0617-41fe-ac11-50503739f2fa', 'volume_name': 'volume-eca08efc-0617-41fe-ac11-50503739f2fa', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1dc272f-7edd-43f9-a275-81a840a462c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1dc272f-7edd-43f9-a275-81a840a462c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b556606e-9170-4c8d-aea6-39796fa3adec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:12 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume eca08efc-0617-41fe-ac11-50503739f2fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eca08efc-0617-41fe-ac11-50503739f2fa', 'volume_size': 1}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Created reservations ['f2672c12-b1fd-4c3a-8f7f-d2de513d6b18', '60844440-f128-42df-8064-059817273c46', 'b62f048a-5ba7-460e-bc22-9a62d602188e', 'c5b0acaa-4c75-4291-829a-4c86acf30634'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Delete snapshot completed successfully.
Sep 25 15:22:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-eaf013e1-e727-4138-93f0-5492a19cdc87 tempest-ProjectReaderTests-21771653 None] Lock "cinder-9ae33aec-8dfa-43db-b822-f113147ddb82-delete_snapshot" released by "delete_snapshot" :: held 3.065s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Flow 'volume_create_manager' (c6675236-2fbe-4246-bb4f-f355d39e0e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22468940-102b-472f-b8bb-ec6cebafdbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22468940-102b-472f-b8bb-ec6cebafdbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1794731064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0319e6-1d67-4a8d-9e71-8fc52acc5a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd00f5586b2042239c160db84830928e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:13Z,use_quota=True,user_id='d9987053abe74e73aa39016a41f06410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea18a9fe-9f83-4ca1-abf7-4b9d0e943b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea18a9fe-9f83-4ca1-abf7-4b9d0e943b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bec2818-3ce0-4630-a11d-d7b88c06ca4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:13 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bec2818-3ce0-4630-a11d-d7b88c06ca4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a0319e6-1d67-4a8d-9e71-8fc52acc5a22', 'volume_name': 'volume-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cacb4b-e7c2-4c23-9cb1-1ff658e2169d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cacb4b-e7c2-4c23-9cb1-1ff658e2169d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff56b943-50d2-4ab8-a2e1-26786dd93253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:13 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume 5a0319e6-1d67-4a8d-9e71-8fc52acc5a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22', 'volume_size': 1}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3d3451b7-7446-4679-9982-ed02a951e048 1073741824" returned: 0 in 1.058s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3d3451b7-7446-4679-9982-ed02a951e048 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:13 devstack sudo[107266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3d3451b7-7446-4679-9982-ed02a951e048
Sep 25 15:22:13 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-453764c9-82b0-4306-913b-5d0357a2bee2-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Lock "cinder-453764c9-82b0-4306-913b-5d0357a2bee2-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Flow 'volume_create_manager' (e2405373-4c6b-47f6-a193-c4546e8db77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5db3cd-eb8d-48b8-92ec-eb7f72abb9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5db3cd-eb8d-48b8-92ec-eb7f72abb9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1818443223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9573106e-52b6-44e9-b49a-f7afd71ddd10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd00f5586b2042239c160db84830928e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:14Z,use_quota=True,user_id='d9987053abe74e73aa39016a41f06410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9365395-e572-46ec-85d4-5353a61bc3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9365395-e572-46ec-85d4-5353a61bc3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:13 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9d79e8-fa10-4962-a26a-ca6b9826db70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9d79e8-fa10-4962-a26a-ca6b9826db70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9573106e-52b6-44e9-b49a-f7afd71ddd10', 'volume_name': 'volume-9573106e-52b6-44e9-b49a-f7afd71ddd10', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e132c7-d7e2-4aa7-a0dd-6fd16d7230e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e132c7-d7e2-4aa7-a0dd-6fd16d7230e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777c6b67-b3c4-4aa0-8a7f-da6c820303c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:13 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume 9573106e-52b6-44e9-b49a-f7afd71ddd10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9573106e-52b6-44e9-b49a-f7afd71ddd10', 'volume_size': 1}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3d3451b7-7446-4679-9982-ed02a951e048" returned: 0 in 0.509s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.296s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1760659249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca08efc-0617-41fe-ac11-50503739f2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd00f5586b2042239c160db84830928e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:12Z,use_quota=True,user_id='d9987053abe74e73aa39016a41f06410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Creating volume eca08efc-0617-41fe-ac11-50503739f2fa {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:13 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eca08efc-0617-41fe-ac11-50503739f2fa 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:13 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-quobyte-453764c9-82b0-4306-913b-5d0357a2bee2" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-453764c9-82b0-4306-913b-5d0357a2bee2" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:14 devstack sudo[107271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eca08efc-0617-41fe-ac11-50503739f2fa 1073741824
Sep 25 15:22:14 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:14 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eef1f39-c0a7-4aad-830a-8587c23f5597]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15caa316-077f-4912-be61-768185d6cae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d3451b7-7446-4679-9982-ed02a951e048', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c558886-9702-481f-9bae-bcf6b11f695f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:14 devstack sudo[107273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2
Sep 25 15:22:14 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:14 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume volume-3d3451b7-7446-4679-9982-ed02a951e048 (3d3451b7-7446-4679-9982-ed02a951e048): created successfully
Sep 25 15:22:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c558886-9702-481f-9bae-bcf6b11f695f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Flow 'volume_create_manager' (d2b225ad-668c-4e24-a072-689ea999083e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d06b5085-6287-44ac-8d5b-21d561d7a932 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Created volume successfully.
Sep 25 15:22:14 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eca08efc-0617-41fe-ac11-50503739f2fa 1073741824" returned: 0 in 0.626s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:14 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2" returned: 0 in 0.546s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:14 devstack sudo[107283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2
Sep 25 15:22:14 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eca08efc-0617-41fe-ac11-50503739f2fa {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:14 devstack sudo[107285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eca08efc-0617-41fe-ac11-50503739f2fa
Sep 25 15:22:14 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:15 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-453764c9-82b0-4306-913b-5d0357a2bee2" returned: 0 in 0.486s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-453764c9-82b0-4306-913b-5d0357a2bee2" released by "delete_volume" :: held 1.132s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Created reservations ['b2751d2c-a4ad-4f99-9790-ac4f57b88399', '7ce7a89d-ae8a-4dc2-98f5-5cd07b7d9ce4', 'd9253d47-dc64-47c2-bb09-2fee017e96c4', 'dfac75a3-6618-4792-b65d-db9e21bad5e0'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:15 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eca08efc-0617-41fe-ac11-50503739f2fa" returned: 0 in 0.485s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.868s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1794731064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0319e6-1d67-4a8d-9e71-8fc52acc5a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd00f5586b2042239c160db84830928e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:13Z,use_quota=True,user_id='d9987053abe74e73aa39016a41f06410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Creating volume 5a0319e6-1d67-4a8d-9e71-8fc52acc5a22 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:15 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:15 devstack sudo[107289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22 1073741824
Sep 25 15:22:15 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b556606e-9170-4c8d-aea6-39796fa3adec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eca08efc-0617-41fe-ac11-50503739f2fa', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e3d3d9-e340-422a-9880-36778306ecfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume volume-eca08efc-0617-41fe-ac11-50503739f2fa (eca08efc-0617-41fe-ac11-50503739f2fa): created successfully
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e3d3d9-e340-422a-9880-36778306ecfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Flow 'volume_create_manager' (073b074f-b052-40e2-9c3f-19eabbf6424d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-cc8f842a-ca94-4328-a626-b1d045e80548 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Created volume successfully.
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:15 devstack sudo[107291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:15 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Flow 'volume_create_manager' (c8c0aea3-d25e-44e4-87fd-0b2de933c35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d039e761-235d-4ea2-9986-e6520f6d42cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d039e761-235d-4ea2-9986-e6520f6d42cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1435449863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21400f77-0610-43aa-951d-be0cbc5114b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd00f5586b2042239c160db84830928e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:15Z,use_quota=True,user_id='d9987053abe74e73aa39016a41f06410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f32ffd-489a-42cf-bc20-df3b80b455f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f32ffd-489a-42cf-bc20-df3b80b455f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827b42b1-4011-4b17-af4c-4a8ca0f77a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827b42b1-4011-4b17-af4c-4a8ca0f77a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21400f77-0610-43aa-951d-be0cbc5114b7', 'volume_name': 'volume-21400f77-0610-43aa-951d-be0cbc5114b7', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72b3754-e345-4bd2-8c36-5f120e92dda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72b3754-e345-4bd2-8c36-5f120e92dda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f35b84-7497-4259-834d-54a912eb1fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:15 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume 21400f77-0610-43aa-951d-be0cbc5114b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21400f77-0610-43aa-951d-be0cbc5114b7', 'volume_size': 1}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:15 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.330s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:15 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Deleted volume successfully.
Sep 25 15:22:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4f3c38a-e4a2-4853-8094-51f06eb64b7e tempest-ProjectReaderTests-21771653 None] Lock "cinder-453764c9-82b0-4306-913b-5d0357a2bee2-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:16 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22 1073741824" returned: 0 in 0.747s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=180,cinder:UPDATE=225,cinder:INSERT=58,cinder:DELETE=18 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:16 devstack sudo[107298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22
Sep 25 15:22:16 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:16 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22" returned: 0 in 0.345s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.459s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1818443223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9573106e-52b6-44e9-b49a-f7afd71ddd10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd00f5586b2042239c160db84830928e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:14Z,use_quota=True,user_id='d9987053abe74e73aa39016a41f06410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Creating volume 9573106e-52b6-44e9-b49a-f7afd71ddd10 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:16 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9573106e-52b6-44e9-b49a-f7afd71ddd10 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff56b943-50d2-4ab8-a2e1-26786dd93253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1b6074-b400-4b02-9c52-25c048299249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume volume-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22 (5a0319e6-1d67-4a8d-9e71-8fc52acc5a22): created successfully
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1b6074-b400-4b02-9c52-25c048299249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:16 devstack sudo[107301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9573106e-52b6-44e9-b49a-f7afd71ddd10 1073741824
Sep 25 15:22:16 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Flow 'volume_create_manager' (c6675236-2fbe-4246-bb4f-f355d39e0e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d988a096-83aa-40f5-b787-0eaf30c85f48 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Created volume successfully.
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Flow 'volume_create_manager' (4cac3f82-d803-4398-90d7-181e92e2e643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162ff53a-5b79-45f8-8576-6b37dd3c7a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162ff53a-5b79-45f8-8576-6b37dd3c7a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-544956092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e165a1-2e88-4b3f-bcd8-1177eb9c08fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06322166606245ae9d97610679e2ce30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:17Z,use_quota=True,user_id='9de10c7c009846479fbca2cb58cc032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ee17e6-040d-44b5-ae6c-64374e27cfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ee17e6-040d-44b5-ae6c-64374e27cfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85edd95-f37c-4a39-aefe-627c272693f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85edd95-f37c-4a39-aefe-627c272693f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e165a1-2e88-4b3f-bcd8-1177eb9c08fe', 'volume_name': 'volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486e1cb0-5a64-4cdc-b1f4-64fa7a36d9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486e1cb0-5a64-4cdc-b1f4-64fa7a36d9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718622a4-873e-43c7-8b91-8d2916f93879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:16 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Volume 10e165a1-2e88-4b3f-bcd8-1177eb9c08fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe', 'volume_size': 1}
Sep 25 15:22:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:17 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9573106e-52b6-44e9-b49a-f7afd71ddd10 1073741824" returned: 0 in 0.626s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9573106e-52b6-44e9-b49a-f7afd71ddd10 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:17 devstack sudo[107307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9573106e-52b6-44e9-b49a-f7afd71ddd10
Sep 25 15:22:17 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:17 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9573106e-52b6-44e9-b49a-f7afd71ddd10" returned: 0 in 0.299s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.684s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1435449863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21400f77-0610-43aa-951d-be0cbc5114b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd00f5586b2042239c160db84830928e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:15Z,use_quota=True,user_id='d9987053abe74e73aa39016a41f06410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Creating volume 21400f77-0610-43aa-951d-be0cbc5114b7 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:17 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-21400f77-0610-43aa-951d-be0cbc5114b7 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777c6b67-b3c4-4aa0-8a7f-da6c820303c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9573106e-52b6-44e9-b49a-f7afd71ddd10', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a0b42e-b793-40ad-a41e-bce9a369be55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:17 devstack sudo[107310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-21400f77-0610-43aa-951d-be0cbc5114b7 1073741824
Sep 25 15:22:17 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:17 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume volume-9573106e-52b6-44e9-b49a-f7afd71ddd10 (9573106e-52b6-44e9-b49a-f7afd71ddd10): created successfully
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a0b42e-b793-40ad-a41e-bce9a369be55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:17 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Flow 'volume_create_manager' (e2405373-4c6b-47f6-a193-c4546e8db77d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7d71b7ba-8ba6-4eeb-a1c4-d9766750d7da tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Created volume successfully.
Sep 25 15:22:18 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-21400f77-0610-43aa-951d-be0cbc5114b7 1073741824" returned: 0 in 0.704s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-21400f77-0610-43aa-951d-be0cbc5114b7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:18 devstack sudo[107317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-21400f77-0610-43aa-951d-be0cbc5114b7
Sep 25 15:22:18 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:18 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-21400f77-0610-43aa-951d-be0cbc5114b7" returned: 0 in 0.327s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.583s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-544956092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e165a1-2e88-4b3f-bcd8-1177eb9c08fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06322166606245ae9d97610679e2ce30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:17Z,use_quota=True,user_id='9de10c7c009846479fbca2cb58cc032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Creating volume 10e165a1-2e88-4b3f-bcd8-1177eb9c08fe {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:18 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f35b84-7497-4259-834d-54a912eb1fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21400f77-0610-43aa-951d-be0cbc5114b7', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:18 devstack sudo[107320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe 1073741824
Sep 25 15:22:18 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a3d285-fd1f-4d99-96d4-7145cce4a68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:18 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Volume volume-21400f77-0610-43aa-951d-be0cbc5114b7 (21400f77-0610-43aa-951d-be0cbc5114b7): created successfully
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a3d285-fd1f-4d99-96d4-7145cce4a68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Flow 'volume_create_manager' (c8c0aea3-d25e-44e4-87fd-0b2de933c35d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-6a9d9652-ebd5-4094-9411-d4dc30fdc100 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Created volume successfully.
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "cinder-21400f77-0610-43aa-951d-be0cbc5114b7-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-21400f77-0610-43aa-951d-be0cbc5114b7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "cinder-quobyte-21400f77-0610-43aa-951d-be0cbc5114b7" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:19 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-quobyte-21400f77-0610-43aa-951d-be0cbc5114b7" acquired by "delete_volume" :: waited 0.041s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbecc7e-81ad-4d67-bb0f-de39c4b1baf3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-21400f77-0610-43aa-951d-be0cbc5114b7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:19 devstack sudo[107325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-21400f77-0610-43aa-951d-be0cbc5114b7
Sep 25 15:22:19 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:19 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe 1073741824" returned: 0 in 0.884s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:19 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe
Sep 25 15:22:19 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:19 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-21400f77-0610-43aa-951d-be0cbc5114b7" returned: 0 in 0.830s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-21400f77-0610-43aa-951d-be0cbc5114b7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:20 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe" returned: 0 in 0.547s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:20 devstack sudo[107334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-21400f77-0610-43aa-951d-be0cbc5114b7
Sep 25 15:22:20 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718622a4-873e-43c7-8b91-8d2916f93879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7035db85-7ce6-47fe-975b-374e4e93f26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:20 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Volume volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe (10e165a1-2e88-4b3f-bcd8-1177eb9c08fe): created successfully
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7035db85-7ce6-47fe-975b-374e4e93f26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Flow 'volume_create_manager' (4cac3f82-d803-4398-90d7-181e92e2e643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:20 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-44172a6f-c623-4146-87e8-dbff347f2638 tempest-ProjectReaderTests-21771653 None] Created volume successfully.
Sep 25 15:22:20 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-21400f77-0610-43aa-951d-be0cbc5114b7" returned: 0 in 0.555s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-quobyte-21400f77-0610-43aa-951d-be0cbc5114b7" released by "delete_volume" :: held 1.451s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Created reservations ['bbb6d2dc-fa92-4eea-82da-f9e22696adc4', 'ae16d2dd-269c-46af-b2f7-a91a1551642f', 'cba626d0-9618-45c5-88b4-f99c9c398d9f', 'a5e76962-b98c-41f8-bba4-a8959a8cdff4'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:20 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:20 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:21 devstack sudo[107339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:21 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:21 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.407s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:21 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Deleted volume successfully.
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-4bcc2170-97e5-4e02-9c9c-d2315b2c79a8 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-21400f77-0610-43aa-951d-be0cbc5114b7-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "cinder-9573106e-52b6-44e9-b49a-f7afd71ddd10-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-9573106e-52b6-44e9-b49a-f7afd71ddd10-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "cinder-quobyte-9573106e-52b6-44e9-b49a-f7afd71ddd10" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-quobyte-9573106e-52b6-44e9-b49a-f7afd71ddd10" acquired by "delete_volume" :: waited 0.044s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:21 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.723s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cd5d45-8d9a-439b-907a-fc2a333e9158]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9573106e-52b6-44e9-b49a-f7afd71ddd10 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] Creating offline snapshot b777aa5b-83ca-4274-9551-0b94728e4972 of volume 10e165a1-2e88-4b3f-bcd8-1177eb9c08fe {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 29 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>, <Thread(Rabbit-heartbeat, started daemon 129983531771584)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6728062f-a088-4b13-8dfa-07956d2737b1]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:21 devstack sudo[107343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9573106e-52b6-44e9-b49a-f7afd71ddd10
Sep 25 15:22:21 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:21 devstack sudo[107344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe
Sep 25 15:22:21 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:22 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9573106e-52b6-44e9-b49a-f7afd71ddd10" returned: 0 in 0.500s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9573106e-52b6-44e9-b49a-f7afd71ddd10 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:22 devstack sudo[107353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9573106e-52b6-44e9-b49a-f7afd71ddd10
Sep 25 15:22:22 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:22 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe" returned: 0 in 0.528s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:22 devstack sudo[107355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972 1G
Sep 25 15:22:22 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:22 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9573106e-52b6-44e9-b49a-f7afd71ddd10" returned: 0 in 0.367s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-quobyte-9573106e-52b6-44e9-b49a-f7afd71ddd10" released by "delete_volume" :: held 0.953s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:22 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Created reservations ['c8d3b24d-d555-4ba3-ab21-b513b8cdd48d', '146ecd56-28a1-400b-bde3-56ecb18b6dec', 'b7a3cba7-6028-4e2f-b421-b574be3952cc', 'e7293739-de9d-400c-abd2-1124de0d706b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:22 devstack sudo[107362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:22 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:22 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972 1G" returned: 0 in 0.657s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:22 devstack sudo[107364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972
Sep 25 15:22:22 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:23 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.417s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Flow 'volume_create_manager' (50f21f5e-60cd-47fd-83c9-3fc294145b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:23 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c41fe5-fecc-467e-b432-fe1869aa34e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Deleted volume successfully.
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972" returned: 0 in 0.411s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:23 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972 is being set with open permissions: ugo+rw
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c41fe5-fecc-467e-b432-fe1869aa34e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-392707523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e781c7da7444adbc8461dd4ec5014d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:23Z,use_quota=True,user_id='21481f699a4248aab560b9b1a7720daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:23 devstack sudo[107370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972
Sep 25 15:22:23 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12c2dbb-8169-4e23-982c-fcb907dfce07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12c2dbb-8169-4e23-982c-fcb907dfce07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc08939-32b9-408d-b26f-d22bd0602432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc08939-32b9-408d-b26f-d22bd0602432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a', 'volume_name': 'volume-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c76511-5e22-4a9a-8660-e3382f4b9e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c76511-5e22-4a9a-8660-e3382f4b9e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee432be-226b-46cb-b01b-57bb15558a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:23 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Volume d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a', 'volume_size': 1}
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e86537b-2bd2-4439-9caa-0c7697009be3 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-9573106e-52b6-44e9-b49a-f7afd71ddd10-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:23 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972" returned: 0 in 0.316s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:23 devstack sudo[107373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.info
Sep 25 15:22:23 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:23 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "cinder-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:24 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "cinder-quobyte-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.info" returned: 0 in 0.320s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:24 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.info is being set with open permissions: ugo+rw
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-quobyte-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22" acquired by "delete_volume" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:24 devstack sudo[107376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.info
Sep 25 15:22:24 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3179158d-a53d-4dab-9ba7-03f3faef5868]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:24 devstack sudo[107378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22
Sep 25 15:22:24 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:24 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.info" returned: 0 in 0.351s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.746s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.005s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-392707523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e781c7da7444adbc8461dd4ec5014d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:23Z,use_quota=True,user_id='21481f699a4248aab560b9b1a7720daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Creating volume d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:24 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:24 devstack sudo[107381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a 1073741824
Sep 25 15:22:24 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:24 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-49a6ad99-b6b4-46f6-aca7-7bf733b9db64 tempest-ProjectReaderTests-21771653 None] Create snapshot completed successfully
Sep 25 15:22:24 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22" returned: 0 in 0.498s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:24 devstack sudo[107386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22
Sep 25 15:22:24 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-b777aa5b-83ca-4274-9551-0b94728e4972-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Lock "cinder-b777aa5b-83ca-4274-9551-0b94728e4972-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-quobyte-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-quobyte-b777aa5b-83ca-4274-9551-0b94728e4972" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-b777aa5b-83ca-4274-9551-0b94728e4972" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Deleting offline snapshot b777aa5b-83ca-4274-9551-0b94728e4972 of volume 10e165a1-2e88-4b3f-bcd8-1177eb9c08fe {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] snapshot_file for this snap is: volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71d9f5b-1c67-436d-b393-a6e77fff2153]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:25 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22" returned: 0 in 0.494s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-quobyte-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22" released by "delete_volume" :: held 1.068s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:25 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:25 devstack sudo[107393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972
Sep 25 15:22:25 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a 1073741824" returned: 0 in 0.735s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Created reservations ['448ea65a-4699-4112-96af-e592b2fda651', 'da467cb0-3b55-4b6d-abfc-95e2bc007bb1', 'c1909941-e9fb-4d56-9a18-9cb1ebdd7166', 'cdcea918-5b40-4e3a-9cb8-5f3fe163cec2'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:25 devstack sudo[107395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a
Sep 25 15:22:25 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:25 devstack sudo[107397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:25 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:25 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972" returned: 0 in 0.501s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[070adc81-2149-455d-8c61-a9634ed83b47]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:25 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a" returned: 0 in 0.421s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee432be-226b-46cb-b01b-57bb15558a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b2fa36-cfee-430b-9a8d-d2e0801a5b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:25 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Volume volume-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a (d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a): created successfully
Sep 25 15:22:25 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b2fa36-cfee-430b-9a8d-d2e0801a5b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Flow 'volume_create_manager' (50f21f5e-60cd-47fd-83c9-3fc294145b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.366s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Deleted volume successfully.
Sep 25 15:22:25 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9b7dcac5-6f11-4aa0-a3ee-a49e68727179 tempest-ProjectReaderTests-336388683 None] Created volume successfully.
Sep 25 15:22:25 devstack sudo[107403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe
Sep 25 15:22:25 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:25 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f5810661-f7b2-4beb-8239-2e62d218c74a tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-5a0319e6-1d67-4a8d-9e71-8fc52acc5a22-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:26 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe" returned: 0 in 0.474s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:26 devstack sudo[107409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972
Sep 25 15:22:26 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "cinder-eca08efc-0617-41fe-ac11-50503739f2fa-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-eca08efc-0617-41fe-ac11-50503739f2fa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "cinder-quobyte-eca08efc-0617-41fe-ac11-50503739f2fa" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-quobyte-eca08efc-0617-41fe-ac11-50503739f2fa" acquired by "delete_volume" :: waited 0.023s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d3f1f-64ee-4147-93a7-73dea07c0342]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eca08efc-0617-41fe-ac11-50503739f2fa {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:26 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972" returned: 0 in 0.530s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:26 devstack sudo[107414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eca08efc-0617-41fe-ac11-50503739f2fa
Sep 25 15:22:26 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:26 devstack sudo[107415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972
Sep 25 15:22:26 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Acquiring lock "cinder-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:26 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe.b777aa5b-83ca-4274-9551-0b94728e4972" returned: 0 in 0.355s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:27 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Lock "cinder-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eca08efc-0617-41fe-ac11-50503739f2fa" returned: 0 in 0.577s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eca08efc-0617-41fe-ac11-50503739f2fa {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-b777aa5b-83ca-4274-9551-0b94728e4972" released by "_delete_snapshot" :: held 2.051s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe" released by "delete_snapshot" :: held 2.088s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:27 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eca08efc-0617-41fe-ac11-50503739f2fa
Sep 25 15:22:27 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Acquiring lock "cinder-quobyte-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Lock "cinder-quobyte-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[046880fc-d200-46f2-98c3-16ef27585be5]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Created reservations ['a7695c17-e2c7-4c62-915c-65d7926cfd19', 'bd9a2694-0d69-4ac1-8962-b9e3cdb82262', '4040f31b-8424-42ff-b793-76f2fd1a1466', '74dd631c-0dd1-4ad4-876c-0ab8ebdd8ec3'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Delete snapshot completed successfully.
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-9c1e9fb8-4c3b-471e-9fc6-613e985aedef tempest-ProjectReaderTests-21771653 None] Lock "cinder-b777aa5b-83ca-4274-9551-0b94728e4972-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:27 devstack sudo[107424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a
Sep 25 15:22:27 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:27 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eca08efc-0617-41fe-ac11-50503739f2fa" returned: 0 in 0.344s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-quobyte-eca08efc-0617-41fe-ac11-50503739f2fa" released by "delete_volume" :: held 0.988s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Created reservations ['cccfd48e-0aab-4b49-8fee-d7a1b55e4723', '5d215453-ed8f-420f-9dfc-c3b1d74c223f', '8b57c516-a55f-48cb-99d5-e2c258915109', 'e18127c4-b324-4482-b353-5a78bd9f668e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:27 devstack sudo[107429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:27 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:27 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a" returned: 0 in 0.624s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:27 devstack sudo[107432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a
Sep 25 15:22:27 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:27 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.286s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:27 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Deleted volume successfully.
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ecc0a9f7-1ae9-4249-b28e-144a9a471864 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-eca08efc-0617-41fe-ac11-50503739f2fa-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:28 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a" returned: 0 in 0.299s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Lock "cinder-quobyte-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a" released by "delete_volume" :: held 0.980s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Lock "cinder-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Created reservations ['fe44b77b-ab86-4566-adaf-9c8de2ae9807', '775a383b-fd4f-4e47-92a7-a214e01e258c', '3cd1b4b2-25b6-4710-803f-4052b56ef03c', '8266d41b-6bd4-47dc-a176-e9f9c977918c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-quobyte-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe" acquired by "delete_volume" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0428570-7d33-45ac-a3b4-dba5ef267fb9]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:28 devstack sudo[107438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:28 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:28 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe
Sep 25 15:22:28 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:28 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.320s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:28 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Deleted volume successfully.
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "cinder-3d3451b7-7446-4679-9982-ed02a951e048-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2186364a-55e7-4190-82e1-6e8691f8c49a tempest-ProjectReaderTests-336388683 None] Lock "cinder-d6d11af2-cfb1-4e4e-9e52-55c62b4ffa1a-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-3d3451b7-7446-4679-9982-ed02a951e048-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "cinder-quobyte-3d3451b7-7446-4679-9982-ed02a951e048" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:28 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe" returned: 0 in 0.481s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-quobyte-3d3451b7-7446-4679-9982-ed02a951e048" acquired by "delete_volume" :: waited 0.038s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:28 devstack sudo[107445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe
Sep 25 15:22:28 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e1e8f5-47b2-437d-bcf0-bda55470033e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3d3451b7-7446-4679-9982-ed02a951e048 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:29 devstack sudo[107447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3d3451b7-7446-4679-9982-ed02a951e048
Sep 25 15:22:29 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:29 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe" returned: 0 in 0.536s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe" released by "delete_volume" :: held 1.120s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:29 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Created reservations ['66bf42eb-69a7-4186-ba59-945c98af3eb5', '77b7298b-bf86-43ca-9b28-aa862cd736b2', '6bb4f507-a367-48ca-bb92-040ad3b91d91', 'cd17004a-5073-4811-a919-636b9a71b498'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:29 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3d3451b7-7446-4679-9982-ed02a951e048" returned: 0 in 0.683s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3d3451b7-7446-4679-9982-ed02a951e048 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:29 devstack sudo[107453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3d3451b7-7446-4679-9982-ed02a951e048
Sep 25 15:22:29 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:29 devstack sudo[107455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:29 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:29 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3d3451b7-7446-4679-9982-ed02a951e048" returned: 0 in 0.400s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-quobyte-3d3451b7-7446-4679-9982-ed02a951e048" released by "delete_volume" :: held 1.153s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Created reservations ['144afc05-242d-4617-b300-12facda3dd4a', '77d33d09-db87-4909-a79f-86a0b60b3ada', '371b4b19-0697-4585-a985-6483a8f0c215', '5330a894-7ca6-4e68-86b5-1b01235033e2'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:30 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.414s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Deleted volume successfully.
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Flow 'volume_create_manager' (16f73bb4-05fe-4c06-a240-05cf47ee0588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d630ad-dc56-46b6-a482-d85e75f4b927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d630ad-dc56-46b6-a482-d85e75f4b927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1742696720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5a575a-53e4-4e2e-ac70-3825fdd65ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e781c7da7444adbc8461dd4ec5014d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:30Z,use_quota=True,user_id='21481f699a4248aab560b9b1a7720daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760866fd-d861-4444-bd10-66defd629282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760866fd-d861-4444-bd10-66defd629282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b7c20d-ef47-449a-bb25-8d9c79438202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b7c20d-ef47-449a-bb25-8d9c79438202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a5a575a-53e4-4e2e-ac70-3825fdd65ad5', 'volume_name': 'volume-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b9b30d-152f-4333-ac97-7cfc8f32be5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b9b30d-152f-4333-ac97-7cfc8f32be5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643fea53-8214-4e75-92dc-845a51399da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:30 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Volume 7a5a575a-53e4-4e2e-ac70-3825fdd65ad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5', 'volume_size': 1}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1742696720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5a575a-53e4-4e2e-ac70-3825fdd65ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e781c7da7444adbc8461dd4ec5014d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:30Z,use_quota=True,user_id='21481f699a4248aab560b9b1a7720daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Creating volume 7a5a575a-53e4-4e2e-ac70-3825fdd65ad5 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:30 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b986f0cd-63fd-4045-860c-89374043bd5b tempest-ProjectReaderTests-21771653 None] Lock "cinder-10e165a1-2e88-4b3f-bcd8-1177eb9c08fe-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:30 devstack sudo[107459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5 1073741824
Sep 25 15:22:30 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:30 devstack sudo[107461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:30 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:30 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.328s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:30 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Deleted volume successfully.
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2a2f377a-ce2c-479a-987e-6583f058ed13 tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-3d3451b7-7446-4679-9982-ed02a951e048-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:30 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5 1073741824" returned: 0 in 0.638s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:31 devstack sudo[107468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5
Sep 25 15:22:31 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "cinder-6486490a-e5b8-47a3-80e1-818dc6402adc-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-6486490a-e5b8-47a3-80e1-818dc6402adc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "cinder-quobyte-6486490a-e5b8-47a3-80e1-818dc6402adc" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-quobyte-6486490a-e5b8-47a3-80e1-818dc6402adc" acquired by "delete_volume" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cd3a4c-e6fd-423d-ac83-e0f044fec22f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6486490a-e5b8-47a3-80e1-818dc6402adc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:31 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Flow 'volume_create_manager' (a5a51a29-6075-4cdf-8ae8-239ccb90e39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d6c46e-99f4-4433-a00a-8cc1e04f15a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5" returned: 0 in 0.369s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d6c46e-99f4-4433-a00a-8cc1e04f15a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1086535748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73cbacfe-ad71-4f31-a2d6-f754efe1e812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06322166606245ae9d97610679e2ce30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:31Z,use_quota=True,user_id='9de10c7c009846479fbca2cb58cc032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24faa769-174a-447e-8df3-88228f594a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24faa769-174a-447e-8df3-88228f594a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e9f462-d770-486b-b285-a0b46b770f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7e9f462-d770-486b-b285-a0b46b770f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73cbacfe-ad71-4f31-a2d6-f754efe1e812', 'volume_name': 'volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff53f8e-0053-498a-b872-e0d029464ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff53f8e-0053-498a-b872-e0d029464ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab5ed4c-c000-4bfb-8b88-a51461d7c7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:31 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Volume 73cbacfe-ad71-4f31-a2d6-f754efe1e812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812', 'volume_size': 1}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1086535748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73cbacfe-ad71-4f31-a2d6-f754efe1e812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06322166606245ae9d97610679e2ce30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:31Z,use_quota=True,user_id='9de10c7c009846479fbca2cb58cc032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Creating volume 73cbacfe-ad71-4f31-a2d6-f754efe1e812 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:31 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:31 devstack sudo[107471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6486490a-e5b8-47a3-80e1-818dc6402adc
Sep 25 15:22:31 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643fea53-8214-4e75-92dc-845a51399da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff20e0f-ed44-4b48-9f8f-a6cd5290ce3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:31 devstack sudo[107472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812 1073741824
Sep 25 15:22:31 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:31 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Volume volume-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5 (7a5a575a-53e4-4e2e-ac70-3825fdd65ad5): created successfully
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff20e0f-ed44-4b48-9f8f-a6cd5290ce3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Flow 'volume_create_manager' (16f73bb4-05fe-4c06-a240-05cf47ee0588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-06a44a17-7853-4d4d-8c6c-24f4eeb41839 tempest-ProjectReaderTests-336388683 None] Created volume successfully.
Sep 25 15:22:31 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6486490a-e5b8-47a3-80e1-818dc6402adc" returned: 0 in 0.550s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6486490a-e5b8-47a3-80e1-818dc6402adc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:31 devstack sudo[107482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6486490a-e5b8-47a3-80e1-818dc6402adc
Sep 25 15:22:31 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:32 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812 1073741824" returned: 0 in 0.638s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:32 devstack sudo[107485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812
Sep 25 15:22:32 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:32 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-6486490a-e5b8-47a3-80e1-818dc6402adc" returned: 0 in 0.339s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-quobyte-6486490a-e5b8-47a3-80e1-818dc6402adc" released by "delete_volume" :: held 0.954s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Created reservations ['26351da9-c5e2-434c-94fd-ecb516ec2df4', '23bc94c7-0e22-4789-a688-7987f0583838', 'bd272056-1d58-45eb-9bfc-7f918ca365bb', '45008d8c-e515-4624-8b1c-d1fcaf287319'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Acquiring lock "cinder-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:32 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812" returned: 0 in 0.385s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Lock "cinder-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab5ed4c-c000-4bfb-8b88-a51461d7c7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:32 devstack sudo[107488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:32 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6911a471-7baf-4027-8cdb-f92e93926ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:32 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Volume volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812 (73cbacfe-ad71-4f31-a2d6-f754efe1e812): created successfully
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6911a471-7baf-4027-8cdb-f92e93926ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Flow 'volume_create_manager' (a5a51a29-6075-4cdf-8ae8-239ccb90e39c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d7a04d79-39e6-4f9d-9d46-f681e92295c1 tempest-ProjectReaderTests-21771653 None] Created volume successfully.
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Acquiring lock "cinder-quobyte-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Lock "cinder-quobyte-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5" acquired by "delete_volume" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5da1b9-a0c7-4cfb-878d-9159348ec81d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:32 devstack sudo[107491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5
Sep 25 15:22:32 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:32 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.422s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:32 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Deleted volume successfully.
Sep 25 15:22:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bffda9d4-fccb-46a7-92c5-e90e2a19f43e tempest-CreateVolumesFromSourceVolumeTest-1558081508 None] Lock "cinder-6486490a-e5b8-47a3-80e1-818dc6402adc-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:33 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5" returned: 0 in 0.466s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:33 devstack sudo[107498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5
Sep 25 15:22:33 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] Creating offline snapshot c7c84fad-9420-48a3-870d-b1d59c047fb4 of volume 73cbacfe-ad71-4f31-a2d6-f754efe1e812 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:22:33 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5" returned: 0 in 0.518s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2390ba25-3741-4078-8672-bdbfbf3a2e4c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Lock "cinder-quobyte-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5" released by "delete_volume" :: held 1.082s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:33 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Created reservations ['06f0e89b-cfd3-4c82-898b-2b548cfbf266', 'ed837c9e-770b-4310-aa78-524840015b0c', '64b9e68d-0580-40ac-8dc0-87bfa7fcfe68', '189f3869-b9ce-4a30-aac5-0a65c3f27cf4'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:33 devstack sudo[107501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812
Sep 25 15:22:33 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:34 devstack sudo[107503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:34 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:34 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.330s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:34 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:34 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Deleted volume successfully.
Sep 25 15:22:34 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812" returned: 0 in 0.636s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:34 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1319351e-2618-4101-9c3b-851b3416f8b3 tempest-ProjectReaderTests-336388683 None] Lock "cinder-7a5a575a-53e4-4e2e-ac70-3825fdd65ad5-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:34 devstack sudo[107509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4 1G
Sep 25 15:22:34 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:35 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4 1G" returned: 0 in 0.615s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:35 devstack sudo[107516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4
Sep 25 15:22:35 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:35 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4" returned: 0 in 0.430s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:35 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4 is being set with open permissions: ugo+rw
Sep 25 15:22:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:35 devstack sudo[107522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4
Sep 25 15:22:35 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:35 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4" returned: 0 in 0.371s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:35 devstack sudo[107525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.info
Sep 25 15:22:35 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:36 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.info" returned: 0 in 0.471s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:36 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.info is being set with open permissions: ugo+rw
Sep 25 15:22:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:36 devstack sudo[107528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.info
Sep 25 15:22:36 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:36 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.info" returned: 0 in 0.469s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.154s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:36 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3dba7098-8058-4a46-b69c-d0b86d1aaa88 tempest-ProjectReaderTests-21771653 None] Create snapshot completed successfully
Sep 25 15:22:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-c7c84fad-9420-48a3-870d-b1d59c047fb4-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Lock "cinder-c7c84fad-9420-48a3-870d-b1d59c047fb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-quobyte-73cbacfe-ad71-4f31-a2d6-f754efe1e812" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-73cbacfe-ad71-4f31-a2d6-f754efe1e812" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-quobyte-c7c84fad-9420-48a3-870d-b1d59c047fb4" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:38 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-c7c84fad-9420-48a3-870d-b1d59c047fb4" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Deleting offline snapshot c7c84fad-9420-48a3-870d-b1d59c047fb4 of volume 73cbacfe-ad71-4f31-a2d6-f754efe1e812 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:22:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] snapshot_file for this snap is: volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:22:38 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89b3c84-17be-4bbb-ae83-33bf18cba763]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:38 devstack sudo[107532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4
Sep 25 15:22:38 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:38 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4" returned: 0 in 0.555s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:22:38 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d83130-b73d-4fc2-88ca-fde3e65d5883]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:38 devstack sudo[107537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812
Sep 25 15:22:38 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:39 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812" returned: 0 in 0.517s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:39 devstack sudo[107542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4
Sep 25 15:22:39 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:39 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4" returned: 0 in 0.552s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:39 devstack sudo[107549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4
Sep 25 15:22:39 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:40 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812.c7c84fad-9420-48a3-870d-b1d59c047fb4" returned: 0 in 0.425s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-c7c84fad-9420-48a3-870d-b1d59c047fb4" released by "_delete_snapshot" :: held 2.279s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-73cbacfe-ad71-4f31-a2d6-f754efe1e812" released by "delete_snapshot" :: held 2.323s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Created reservations ['04c15ae9-1525-433b-881e-ab21634b2912', '301dade0-56ce-44a5-a267-8476a07492f5', 'fe48607c-5a25-439b-8a4e-86b301e41e81', 'e300aa96-cbfa-405a-a9a1-54a7f5e841e1'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Flow 'volume_create_manager' (b6272069-ea19-4b09-802c-72d5e2e87c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007744bf-aa72-43e7-b633-afbc68d1990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007744bf-aa72-43e7-b633-afbc68d1990e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1765555777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb59f9e-3e41-4032-82a8-34e59edaea62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361602c1280b48e4ac3a3f8c3865d083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:40Z,use_quota=True,user_id='27d05e8d066242e1bc6c57c139faa9ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e7a00a6-fd6f-4242-9cff-5e6a4081e7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e7a00a6-fd6f-4242-9cff-5e6a4081e7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36af8570-506e-4c6e-98ca-c0004a22304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36af8570-506e-4c6e-98ca-c0004a22304b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecb59f9e-3e41-4032-82a8-34e59edaea62', 'volume_name': 'volume-ecb59f9e-3e41-4032-82a8-34e59edaea62', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e595f615-1ff9-485b-98ef-9b129d559ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e595f615-1ff9-485b-98ef-9b129d559ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705640a7-1098-4133-9da3-59211124a3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:40 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Volume ecb59f9e-3e41-4032-82a8-34e59edaea62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecb59f9e-3e41-4032-82a8-34e59edaea62', 'volume_size': 1}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1765555777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb59f9e-3e41-4032-82a8-34e59edaea62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361602c1280b48e4ac3a3f8c3865d083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:40Z,use_quota=True,user_id='27d05e8d066242e1bc6c57c139faa9ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Creating volume ecb59f9e-3e41-4032-82a8-34e59edaea62 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:40 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:40 devstack sudo[107552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 1073741824
Sep 25 15:22:40 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:40 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Delete snapshot completed successfully.
Sep 25 15:22:40 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-42410f7b-7560-43e2-a5a5-073894191f43 tempest-ProjectReaderTests-21771653 None] Lock "cinder-c7c84fad-9420-48a3-870d-b1d59c047fb4-delete_snapshot" released by "delete_snapshot" :: held 2.741s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-73cbacfe-ad71-4f31-a2d6-f754efe1e812-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Lock "cinder-73cbacfe-ad71-4f31-a2d6-f754efe1e812-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:41 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 1073741824" returned: 0 in 0.676s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-quobyte-73cbacfe-ad71-4f31-a2d6-f754efe1e812" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-73cbacfe-ad71-4f31-a2d6-f754efe1e812" acquired by "delete_volume" :: waited 0.048s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:41 devstack sudo[107558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62
Sep 25 15:22:41 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b00abd-0844-4213-afea-47a2c358e559]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Flow 'volume_create_manager' (5b40ba94-5dc6-496b-91a3-bbc0fb043162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e0be95-70ef-4775-a7af-54b2be4f7c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e0be95-70ef-4775-a7af-54b2be4f7c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-357049283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96bfa17-d4f2-483f-98d5-8fded00a5c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094e5d9665340f0a68e0ebfbe186a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:42Z,use_quota=True,user_id='d17eaa9ba46641bd81c36ef1b0184127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661dfb56-3cc2-4bd5-aa3a-e9d9f7358e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661dfb56-3cc2-4bd5-aa3a-e9d9f7358e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdca2379-04f4-47d7-baa2-5c2620027dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdca2379-04f4-47d7-baa2-5c2620027dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e96bfa17-d4f2-483f-98d5-8fded00a5c57', 'volume_name': 'volume-e96bfa17-d4f2-483f-98d5-8fded00a5c57', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:41 devstack sudo[107560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812
Sep 25 15:22:41 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c756218-605c-44c4-8fe9-1a6f134852a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c756218-605c-44c4-8fe9-1a6f134852a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb89199-0a8a-4d62-bff9-5eb5d7cceca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:41 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Volume e96bfa17-d4f2-483f-98d5-8fded00a5c57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e96bfa17-d4f2-483f-98d5-8fded00a5c57', 'volume_size': 1}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Flow 'volume_create_manager' (180a6d99-e59e-4e76-a402-c940ba2b3045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86c79b8-2727-4e26-a531-9250cded67a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86c79b8-2727-4e26-a531-9250cded67a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d24de4-9a45-4c73-b2d4-b06f68ff2b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f21671785544769acc6222837484a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:42Z,use_quota=True,user_id='d111074fd78e42ab9c4d8ef6cf2b5c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4813491c-68d2-4c8c-8cbf-4626fa7e653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4813491c-68d2-4c8c-8cbf-4626fa7e653b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce881dc-d1b6-4ce2-8e82-09b2309cddba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.image.glance [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Creating Keystone auth plugin from conf {{(pid=87071) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 15:22:41 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62" returned: 0 in 0.353s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.125s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-357049283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96bfa17-d4f2-483f-98d5-8fded00a5c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094e5d9665340f0a68e0ebfbe186a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:42Z,use_quota=True,user_id='d17eaa9ba46641bd81c36ef1b0184127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Creating volume e96bfa17-d4f2-483f-98d5-8fded00a5c57 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:41 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e96bfa17-d4f2-483f-98d5-8fded00a5c57 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:41 devstack sudo[107563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e96bfa17-d4f2-483f-98d5-8fded00a5c57 1073741824
Sep 25 15:22:41 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705640a7-1098-4133-9da3-59211124a3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb59f9e-3e41-4032-82a8-34e59edaea62', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13eec2d5-e5e1-48e9-b303-a05395646139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:41 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Volume volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 (ecb59f9e-3e41-4032-82a8-34e59edaea62): created successfully
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13eec2d5-e5e1-48e9-b303-a05395646139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:41 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Flow 'volume_create_manager' (b6272069-ea19-4b09-802c-72d5e2e87c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:41 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a041912b-ae00-458a-8f1f-43d75609f67f tempest-SnapshotDependencyTests-1563551071 None] Created volume successfully.
Sep 25 15:22:42 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812" returned: 0 in 0.468s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:42 devstack sudo[107568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812
Sep 25 15:22:42 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce881dc-d1b6-4ce2-8e82-09b2309cddba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '80d24de4-9a45-4c73-b2d4-b06f68ff2b0d', 'volume_name': 'volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d', 'volume_size': 1, 'image_id': 'd1ce8fec-e32b-49f9-b0de-4520e4ce5259', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1ce8fec-e32b-49f9-b0de-4520e4ce5259', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e9cee760307bc08b221a3dd21f60d077', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f21671785544769acc6222837484a00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '36bc4beb6394797a1106f238f1cf8f31c97e7b2079e9d0d85172ece5ec8dcf8fe170359cb683ca5ad5190751dcd497007fc865f81548bd2bdfda0b70f6982a0b', 'id': 'd1ce8fec-e32b-49f9-b0de-4520e4ce5259', 'created_at': datetime.datetime(2026, 9, 25, 13, 22, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 22, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1ce8fec-e32b-49f9-b0de-4520e4ce5259/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x763825de12b0>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9251d63f-0fb1-4d49-9715-ca6a36492d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9251d63f-0fb1-4d49-9715-ca6a36492d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:42 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10d5539-971f-450f-aaed-197fc65fbf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Volume 80d24de4-9a45-4c73-b2d4-b06f68ff2b0d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d', 'volume_size': 1, 'image_id': 'd1ce8fec-e32b-49f9-b0de-4520e4ce5259', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1ce8fec-e32b-49f9-b0de-4520e4ce5259', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e9cee760307bc08b221a3dd21f60d077', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f21671785544769acc6222837484a00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '36bc4beb6394797a1106f238f1cf8f31c97e7b2079e9d0d85172ece5ec8dcf8fe170359cb683ca5ad5190751dcd497007fc865f81548bd2bdfda0b70f6982a0b', 'id': 'd1ce8fec-e32b-49f9-b0de-4520e4ce5259', 'created_at': datetime.datetime(2026, 9, 25, 13, 22, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 22, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1ce8fec-e32b-49f9-b0de-4520e4ce5259/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x763825de12b0>}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Trying to clone 80d24de4-9a45-4c73-b2d4-b06f68ff2b0d from image d1ce8fec-e32b-49f9-b0de-4520e4ce5259 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1ce8fec-e32b-49f9-b0de-4520e4ce5259', 'metadata': {}}]). {{(pid=87071) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-73cbacfe-ad71-4f31-a2d6-f754efe1e812" returned: 0 in 0.312s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-73cbacfe-ad71-4f31-a2d6-f754efe1e812" released by "delete_volume" :: held 0.870s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:42 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e96bfa17-d4f2-483f-98d5-8fded00a5c57 1073741824" returned: 0 in 0.586s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Created reservations ['fb64a5f5-213d-4d35-ad8c-3fa5a28a6241', '966657ec-1548-4917-9337-d8dddac51d55', 'd6c30dd3-d6e3-4c19-8799-e746fe7702d5', 'b561285c-00d1-4937-8b81-77dddf4550d9'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 15:22:42 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e96bfa17-d4f2-483f-98d5-8fded00a5c57 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:42 devstack sudo[107575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e96bfa17-d4f2-483f-98d5-8fded00a5c57
Sep 25 15:22:42 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[061b0721-26c2-40d2-b1c9-b8729e1b0c3d]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:42 devstack sudo[107578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:42 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:42 devstack sudo[107577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD
Sep 25 15:22:42 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:42 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e96bfa17-d4f2-483f-98d5-8fded00a5c57" returned: 0 in 0.360s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb89199-0a8a-4d62-bff9-5eb5d7cceca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96bfa17-d4f2-483f-98d5-8fded00a5c57', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb15926e-c11a-49e6-bbbb-508ce0de18f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:42 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Volume volume-e96bfa17-d4f2-483f-98d5-8fded00a5c57 (e96bfa17-d4f2-483f-98d5-8fded00a5c57): created successfully
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb15926e-c11a-49e6-bbbb-508ce0de18f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:42 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Flow 'volume_create_manager' (5b40ba94-5dc6-496b-91a3-bbc0fb043162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:43 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5efb9786-e120-47f8-bcf7-dfc26b1518dc tempest-ProjectReaderTests-385189714 None] Created volume successfully.
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:43 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] Creating offline snapshot 4c96d149-df42-4301-9e8c-9acc0f61b5be of volume ecb59f9e-3e41-4032-82a8-34e59edaea62 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:22:43 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.397s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f39cee4-1ab0-4df3-8a1a-c5e51a9aba59]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:43 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Deleted volume successfully.
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-01a50e5a-9c5f-4548-b6e7-8d3aa2e1b74d tempest-ProjectReaderTests-21771653 None] Lock "cinder-73cbacfe-ad71-4f31-a2d6-f754efe1e812-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:43 devstack sudo[107585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD
Sep 25 15:22:43 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:43 devstack sudo[107586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62
Sep 25 15:22:43 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:43 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Temporary image d1ce8fec-e32b-49f9-b0de-4520e4ce5259 is fetched for user d111074fd78e42ab9c4d8ef6cf2b5c31. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3260a9d-234e-4c79-965f-e26b919e7100]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:43 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62" returned: 0 in 0.504s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:43 devstack sudo[107597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be 1G
Sep 25 15:22:43 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Acquiring lock "cinder-e96bfa17-d4f2-483f-98d5-8fded00a5c57-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:43 devstack sudo[107596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD
Sep 25 15:22:43 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Lock "cinder-e96bfa17-d4f2-483f-98d5-8fded00a5c57-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Acquiring lock "cinder-quobyte-e96bfa17-d4f2-483f-98d5-8fded00a5c57" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Lock "cinder-quobyte-e96bfa17-d4f2-483f-98d5-8fded00a5c57" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e4ca4c-7127-42ac-bb7d-5903430dc7d3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e96bfa17-d4f2-483f-98d5-8fded00a5c57 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:43 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:43 devstack sudo[107600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e96bfa17-d4f2-483f-98d5-8fded00a5c57
Sep 25 15:22:43 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:44 devstack sudo[107603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD
Sep 25 15:22:44 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:44 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be 1G" returned: 0 in 0.723s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:44 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:44 devstack sudo[107613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be
Sep 25 15:22:44 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Flow 'volume_create_manager' (5cf34e8b-e109-47c4-954e-e1b4b3e3a3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74c5af6-9415-456f-8f67-7e0a03b1aadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e96bfa17-d4f2-483f-98d5-8fded00a5c57" returned: 0 in 0.558s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e96bfa17-d4f2-483f-98d5-8fded00a5c57 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74c5af6-9415-456f-8f67-7e0a03b1aadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-492961920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10cb022c-d71a-4b3b-a14d-8b9ce8cc489b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06322166606245ae9d97610679e2ce30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:44Z,use_quota=True,user_id='9de10c7c009846479fbca2cb58cc032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:44 devstack sudo[107618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e96bfa17-d4f2-483f-98d5-8fded00a5c57
Sep 25 15:22:44 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342e8476-8adf-4b83-8fd8-589f8b29a3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342e8476-8adf-4b83-8fd8-589f8b29a3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a9ff84-3bc4-4c06-9cee-eec2aac9d596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:44 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a9ff84-3bc4-4c06-9cee-eec2aac9d596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10cb022c-d71a-4b3b-a14d-8b9ce8cc489b', 'volume_name': 'volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1030a9a5-8316-456f-b951-8c6a603f38bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1030a9a5-8316-456f-b951-8c6a603f38bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9642e1-ba9c-42b5-8197-fc56683f7de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:44 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Volume 10cb022c-d71a-4b3b-a14d-8b9ce8cc489b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b', 'volume_size': 1}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD" returned: 1 in 0.511s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:44 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be" returned: 0 in 0.358s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:44 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be is being set with open permissions: ugo+rw
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:44 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e96bfa17-d4f2-483f-98d5-8fded00a5c57" returned: 0 in 0.318s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:44 devstack sudo[107625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be
Sep 25 15:22:44 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Lock "cinder-quobyte-e96bfa17-d4f2-483f-98d5-8fded00a5c57" released by "delete_volume" :: held 0.947s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Created reservations ['5a112390-7461-4d26-8ecf-0d44a44a7937', 'd30abbe3-d000-419c-8c2c-100dc7401866', '5e2405fe-6575-4579-9f84-00032ce7ae88', 'aad0f8f4-219b-48c7-aa76-b05cef512946'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:44 devstack sudo[107627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:44 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:44 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be" returned: 0 in 0.303s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:45 devstack sudo[107630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.info
Sep 25 15:22:45 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:45 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.344s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Deleted volume successfully.
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f819d424-743d-4823-971e-aad4f081c392 tempest-ProjectReaderTests-385189714 None] Lock "cinder-e96bfa17-d4f2-483f-98d5-8fded00a5c57-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:45 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.info" returned: 0 in 0.314s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:45 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.info is being set with open permissions: ugo+rw
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:45 devstack sudo[107634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.info
Sep 25 15:22:45 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Flow 'volume_create_manager' (f83b5d98-382e-4b84-8df5-2d503131e2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5993ae-04d8-4691-9a62-37af7cfe266e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5993ae-04d8-4691-9a62-37af7cfe266e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-93478806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3961c1bd-b1fa-4e88-93a4-6898e347c446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094e5d9665340f0a68e0ebfbe186a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:45Z,use_quota=True,user_id='d17eaa9ba46641bd81c36ef1b0184127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae4d0fa-0ef4-4b6c-9991-a0de2ae5f1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae4d0fa-0ef4-4b6c-9991-a0de2ae5f1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1b0fa3-47db-4e03-9947-f470dbf6d88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1b0fa3-47db-4e03-9947-f470dbf6d88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3961c1bd-b1fa-4e88-93a4-6898e347c446', 'volume_name': 'volume-3961c1bd-b1fa-4e88-93a4-6898e347c446', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:45 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2085d23e-56c0-43da-af5e-dab0942ba244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2085d23e-56c0-43da-af5e-dab0942ba244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb56055-506f-4309-9133-04f755cbe222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:45 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Volume 3961c1bd-b1fa-4e88-93a4-6898e347c446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3961c1bd-b1fa-4e88-93a4-6898e347c446', 'volume_size': 1}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.info" returned: 0 in 0.302s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.643s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.234s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-492961920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10cb022c-d71a-4b3b-a14d-8b9ce8cc489b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06322166606245ae9d97610679e2ce30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:44Z,use_quota=True,user_id='9de10c7c009846479fbca2cb58cc032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Creating volume 10cb022c-d71a-4b3b-a14d-8b9ce8cc489b {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:45 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:45 devstack sudo[107637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b 1073741824
Sep 25 15:22:45 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:45 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e7528834-dac7-433f-82b6-0817585b0cb0 tempest-SnapshotDependencyTests-1563551071 None] Create snapshot completed successfully
Sep 25 15:22:46 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b 1073741824" returned: 0 in 0.521s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:46 devstack sudo[107643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b
Sep 25 15:22:46 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:46 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b" returned: 0 in 0.290s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.103s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d24de4-9a45-4c73-b2d4-b06f68ff2b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f21671785544769acc6222837484a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:42Z,use_quota=True,user_id='d111074fd78e42ab9c4d8ef6cf2b5c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Creating volume 80d24de4-9a45-4c73-b2d4-b06f68ff2b0d {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:46 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9642e1-ba9c-42b5-8197-fc56683f7de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607a44e0-f3ab-408e-b181-c14db02b627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:46 devstack sudo[107646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d 1073741824
Sep 25 15:22:46 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:46 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Volume volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b (10cb022c-d71a-4b3b-a14d-8b9ce8cc489b): created successfully
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607a44e0-f3ab-408e-b181-c14db02b627b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Flow 'volume_create_manager' (5cf34e8b-e109-47c4-954e-e1b4b3e3a3e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e2754c20-528f-4bb8-ae6c-68769644b696 tempest-ProjectReaderTests-21771653 None] Created volume successfully.
Sep 25 15:22:46 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Flow 'volume_create_manager' (1841f67f-9761-450a-bbe0-c814c1e924d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa445d4-b0d1-4010-a609-c546e4b58593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa445d4-b0d1-4010-a609-c546e4b58593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8719c4b1-d606-4485-a7a8-9816897384ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361602c1280b48e4ac3a3f8c3865d083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4c96d149-df42-4301-9e8c-9acc0f61b5be,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:47Z,use_quota=True,user_id='27d05e8d066242e1bc6c57c139faa9ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e545c2-5247-4f81-8d53-c3b6abb45ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e545c2-5247-4f81-8d53-c3b6abb45ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5c0071-7b3b-4c8c-9df9-0d68db2e50f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5c0071-7b3b-4c8c-9df9-0d68db2e50f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8719c4b1-d606-4485-a7a8-9816897384ee', 'volume_name': 'volume-8719c4b1-d606-4485-a7a8-9816897384ee', 'volume_size': 1, 'snapshot_id': '4c96d149-df42-4301-9e8c-9acc0f61b5be'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dad2722-e4d3-4e19-9f04-b610a235b73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dad2722-e4d3-4e19-9f04-b610a235b73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d138f552-19eb-436f-9e40-75dde0a931a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Volume 8719c4b1-d606-4485-a7a8-9816897384ee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8719c4b1-d606-4485-a7a8-9816897384ee', 'volume_size': 1, 'snapshot_id': '4c96d149-df42-4301-9e8c-9acc0f61b5be'}
Sep 25 15:22:47 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d 1073741824" returned: 0 in 0.540s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:47 devstack sudo[107652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d
Sep 25 15:22:47 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:47 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d" returned: 0 in 0.265s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.776s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-93478806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3961c1bd-b1fa-4e88-93a4-6898e347c446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094e5d9665340f0a68e0ebfbe186a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:45Z,use_quota=True,user_id='d17eaa9ba46641bd81c36ef1b0184127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Creating volume 3961c1bd-b1fa-4e88-93a4-6898e347c446 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:47 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3961c1bd-b1fa-4e88-93a4-6898e347c446 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=267,cinder:SELECT=179,cinder:INSERT=70,cinder:DELETE=21 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:22:47 devstack sudo[107655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3961c1bd-b1fa-4e88-93a4-6898e347c446 1073741824
Sep 25 15:22:47 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Attempting download of d1ce8fec-e32b-49f9-b0de-4520e4ce5259 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1ce8fec-e32b-49f9-b0de-4520e4ce5259', 'metadata': {}}])) to volume 80d24de4-9a45-4c73-b2d4-b06f68ff2b0d. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e24756-f89e-4cd5-be2f-8bfa58c7017b]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_035t0zls {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:47 devstack sudo[107657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_035t0zls
Sep 25 15:22:47 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:48 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3961c1bd-b1fa-4e88-93a4-6898e347c446 1073741824" returned: 0 in 0.589s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:48 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_035t0zls" returned: 0 in 0.443s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_035t0zls {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3961c1bd-b1fa-4e88-93a4-6898e347c446 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:48 devstack sudo[107666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3961c1bd-b1fa-4e88-93a4-6898e347c446
Sep 25 15:22:48 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:48 devstack sudo[107665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_035t0zls
Sep 25 15:22:48 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:48 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3961c1bd-b1fa-4e88-93a4-6898e347c446" returned: 0 in 0.244s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.212s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "cinder-quobyte-4c96d149-df42-4301-9e8c-9acc0f61b5be-8719c4b1-d606-4485-a7a8-9816897384ee" by "_create_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-quobyte-4c96d149-df42-4301-9e8c-9acc0f61b5be-8719c4b1-d606-4485-a7a8-9816897384ee" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Creating volume 8719c4b1-d606-4485-a7a8-9816897384ee from snapshot 4c96d149-df42-4301-9e8c-9acc0f61b5be {{(pid=87071) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "cinder-quobyte-8719c4b1-d606-4485-a7a8-9816897384ee" by "_copy_volume_from_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:48 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb56055-506f-4309-9133-04f755cbe222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3961c1bd-b1fa-4e88-93a4-6898e347c446', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732cb702-786d-43fa-a970-1ee73d05c20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_035t0zls" returned: 1 in 0.349s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_035t0zls' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ded7fe8-0c7d-4bf2-b3c0-b1b8fb68c6cc]: (4, 'raw') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-quobyte-8719c4b1-d606-4485-a7a8-9816897384ee" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] snapshot: 4c96d149-df42-4301-9e8c-9acc0f61b5be, volume: 8719c4b1-d606-4485-a7a8-9816897384ee,  {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 15:22:48 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Volume volume-3961c1bd-b1fa-4e88-93a4-6898e347c446 (3961c1bd-b1fa-4e88-93a4-6898e347c446): created successfully
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732cb702-786d-43fa-a970-1ee73d05c20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Flow 'volume_create_manager' (f83b5d98-382e-4b84-8df5-2d503131e2d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7708d978-cfd5-4a3b-8bce-26618d01b502 tempest-ProjectReaderTests-385189714 None] Created volume successfully.
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4091b732-22cb-43b3-a975-63088633ee87]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:48 devstack sudo[107673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD
Sep 25 15:22:48 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:48 devstack sudo[107674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be
Sep 25 15:22:48 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:48 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Acquiring lock "cinder-3961c1bd-b1fa-4e88-93a4-6898e347c446-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Lock "cinder-3961c1bd-b1fa-4e88-93a4-6898e347c446-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:48 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:48 devstack sudo[107679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD
Sep 25 15:22:48 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be" returned: 0 in 0.443s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb59f9e-3e41-4032-82a8-34e59edaea62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Acquiring lock "cinder-quobyte-3961c1bd-b1fa-4e88-93a4-6898e347c446" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Lock "cinder-quobyte-3961c1bd-b1fa-4e88-93a4-6898e347c446" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2b03ed-ff99-4393-b7f4-7f75a1d34d93]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[023098f1-7398-4151-9c47-92644fa9c9bd]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3961c1bd-b1fa-4e88-93a4-6898e347c446 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:49 devstack sudo[107684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62
Sep 25 15:22:49 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:49 devstack sudo[107685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3961c1bd-b1fa-4e88-93a4-6898e347c446
Sep 25 15:22:49 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:49 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD" returned: 1 in 0.393s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] d1ce8fec-e32b-49f9-b0de-4520e4ce5259 was raw, converting to qcow2 {{(pid=87071) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:49 devstack sudo[107691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d
Sep 25 15:22:49 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:49 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62" returned: 0 in 0.403s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] will copy from snapshot at /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Creating direct copy from snapshot {{(pid=87071) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG cinder.utils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Path /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8719c4b1-d606-4485-a7a8-9816897384ee not found in is_blk_device check {{(pid=87071) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8719c4b1-d606-4485-a7a8-9816897384ee {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:49 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3961c1bd-b1fa-4e88-93a4-6898e347c446" returned: 0 in 0.397s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3961c1bd-b1fa-4e88-93a4-6898e347c446 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:49 devstack sudo[107700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8719c4b1-d606-4485-a7a8-9816897384ee
Sep 25 15:22:49 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:49 devstack sudo[107703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3961c1bd-b1fa-4e88-93a4-6898e347c446
Sep 25 15:22:49 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:49 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d" returned: 0 in 0.510s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1ce8fec-e32b-49f9-b0de-4520e4ce5259_yo6koj_rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:22:49 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:49 devstack sudo[107712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d 1G
Sep 25 15:22:49 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:49 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3961c1bd-b1fa-4e88-93a4-6898e347c446" returned: 0 in 0.321s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Lock "cinder-quobyte-3961c1bd-b1fa-4e88-93a4-6898e347c446" released by "delete_volume" :: held 0.791s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Created reservations ['8c3cb816-31c5-4015-9e41-cf4d67593652', '353fef45-d521-41df-8457-4a49adf60e86', 'e4f13525-4ec3-4a0e-9c50-0bdd851feebe', '295c9710-b455-40b3-9e49-cf66b51c18de'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:49 devstack sudo[107715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:49 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:50 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.402s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:50 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Deleted volume successfully.
Sep 25 15:22:50 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8405f428-66e5-4948-a794-4fc805ca1e5f tempest-ProjectReaderTests-385189714 None] Lock "cinder-3961c1bd-b1fa-4e88-93a4-6898e347c446-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:50 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d 1G" returned: 0 in 0.712s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:50 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Downloaded image d1ce8fec-e32b-49f9-b0de-4520e4ce5259 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1ce8fec-e32b-49f9-b0de-4520e4ce5259', 'metadata': {}}])) to volume 80d24de4-9a45-4c73-b2d4-b06f68ff2b0d successfully. {{(pid=87071) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 15:22:50 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Temporary image d1ce8fec-e32b-49f9-b0de-4520e4ce5259 for user d111074fd78e42ab9c4d8ef6cf2b5c31 is deleted. {{(pid=87071) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 15:22:50 devstack cinder-volume[87071]: DEBUG cinder.volume.volume_utils [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Marking volume 80d24de4-9a45-4c73-b2d4-b06f68ff2b0d as bootable. {{(pid=87071) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 15:22:50 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Copying metadata from image d1ce8fec-e32b-49f9-b0de-4520e4ce5259 to 80d24de4-9a45-4c73-b2d4-b06f68ff2b0d. {{(pid=87071) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 15:22:50 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Creating volume glance metadata for volume 80d24de4-9a45-4c73-b2d4-b06f68ff2b0d backed by image d1ce8fec-e32b-49f9-b0de-4520e4ce5259 with: {'image_id': 'd1ce8fec-e32b-49f9-b0de-4520e4ce5259', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e9cee760307bc08b221a3dd21f60d077', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87071) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 15:22:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10d5539-971f-450f-aaed-197fc65fbf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d', 'volume_size': 1, 'image_id': 'd1ce8fec-e32b-49f9-b0de-4520e4ce5259', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1ce8fec-e32b-49f9-b0de-4520e4ce5259', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e9cee760307bc08b221a3dd21f60d077', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f21671785544769acc6222837484a00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '36bc4beb6394797a1106f238f1cf8f31c97e7b2079e9d0d85172ece5ec8dcf8fe170359cb683ca5ad5190751dcd497007fc865f81548bd2bdfda0b70f6982a0b', 'id': 'd1ce8fec-e32b-49f9-b0de-4520e4ce5259', 'created_at': datetime.datetime(2026, 9, 25, 13, 22, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 13, 22, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1ce8fec-e32b-49f9-b0de-4520e4ce5259/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x763825de12b0>}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245a15b4-ac5c-44b6-be4e-fcde4e165a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:50 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Volume volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d (80d24de4-9a45-4c73-b2d4-b06f68ff2b0d): created successfully
Sep 25 15:22:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245a15b4-ac5c-44b6-be4e-fcde4e165a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:50 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Flow 'volume_create_manager' (180a6d99-e59e-4e76-a402-c940ba2b3045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:50 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ae3e4c83-6a52-4582-a40c-8bf3e4789ce1 tempest-VolumeImageDependencyTests-557201022 None] Created volume successfully.
Sep 25 15:22:50 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Flow 'volume_create_manager' (6d0f4bf7-488c-4a2b-9d78-18fc72bc18f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621b6d94-c5f2-4a9b-a179-07b57cd6fcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621b6d94-c5f2-4a9b-a179-07b57cd6fcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-274206007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3277626-8574-4421-bedb-08c34357ceae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094e5d9665340f0a68e0ebfbe186a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:51Z,use_quota=True,user_id='d17eaa9ba46641bd81c36ef1b0184127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3634f610-358f-469e-8c5f-c2b7f2b422e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3634f610-358f-469e-8c5f-c2b7f2b422e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3464372b-f608-4129-ac75-c05b6dd4a0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3464372b-f608-4129-ac75-c05b6dd4a0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3277626-8574-4421-bedb-08c34357ceae', 'volume_name': 'volume-a3277626-8574-4421-bedb-08c34357ceae', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf31dbb-86ef-4198-a499-efc941c7ae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf31dbb-86ef-4198-a499-efc941c7ae18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc49ed6-a5a0-4bfe-a4e6-b863452813c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:51 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Volume a3277626-8574-4421-bedb-08c34357ceae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3277626-8574-4421-bedb-08c34357ceae', 'volume_size': 1}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Acquiring lock "cinder-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Lock "cinder-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Acquiring lock "cinder-quobyte-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Lock "cinder-quobyte-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d" acquired by "delete_volume" :: waited 0.031s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cefa7a4-71e3-4298-a0e3-8a481806ffd2]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:51 devstack sudo[107729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d
Sep 25 15:22:51 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:52 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d" returned: 0 in 0.607s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:52 devstack sudo[107734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d
Sep 25 15:22:52 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:52 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d" returned: 0 in 0.449s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Lock "cinder-quobyte-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d" released by "delete_volume" :: held 1.150s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:52 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Created reservations ['e5f863ee-9b82-413b-8b17-f8eb2410ea44', '5fb8d343-73b6-437c-a09e-56fe3516ea64', 'b0da3b44-8507-47e9-8d72-cbde0388f996', '8d07651d-65ba-4717-9c84-43d475c6aa6e'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:22:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:53 devstack sudo[107740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:22:53 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:53 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.361s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:53 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:22:53 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Deleted volume successfully.
Sep 25 15:22:53 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-7f6c75d2-c9df-48f1-8535-034c3ac0981c tempest-VolumeImageDependencyTests-557201022 None] Lock "cinder-80d24de4-9a45-4c73-b2d4-b06f68ff2b0d-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:56 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8719c4b1-d606-4485-a7a8-9816897384ee" returned: 0 in 7.620s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:56 devstack cinder-volume[87071]: DEBUG cinder.image.image_utils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Image conversion details: src /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62, size 1024.00 MB, duration 7.62 sec, destination /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8719c4b1-d606-4485-a7a8-9816897384ee {{(pid=87071) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 15:22:56 devstack cinder-volume[87071]: INFO cinder.image.image_utils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Converted 1024.00 MB image at 134.36 MB/s
Sep 25 15:22:56 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8719c4b1-d606-4485-a7a8-9816897384ee is being set with open permissions: ugo+rw
Sep 25 15:22:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8719c4b1-d606-4485-a7a8-9816897384ee {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:57 devstack sudo[107750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8719c4b1-d606-4485-a7a8-9816897384ee
Sep 25 15:22:57 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:57 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8719c4b1-d606-4485-a7a8-9816897384ee" returned: 0 in 0.263s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-quobyte-8719c4b1-d606-4485-a7a8-9816897384ee" released by "_copy_volume_from_snapshot" :: held 8.883s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:57 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-quobyte-4c96d149-df42-4301-9e8c-9acc0f61b5be-8719c4b1-d606-4485-a7a8-9816897384ee" released by "_create_volume_from_snapshot" :: held 8.984s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:22:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.004s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.549s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] Creating offline snapshot 483aef02-2faa-4442-acc0-461f576ed3d2 of volume 10cb022c-d71a-4b3b-a14d-8b9ce8cc489b {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:22:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d138f552-19eb-436f-9e40-75dde0a931a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8719c4b1-d606-4485-a7a8-9816897384ee', 'volume_size': 1, 'snapshot_id': '4c96d149-df42-4301-9e8c-9acc0f61b5be'}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af12d11e-2061-4f74-8c0f-777be67348c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:22:57 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0760846f-2eb2-4fd0-82ce-dcc119f98ccf]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:57 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Volume volume-8719c4b1-d606-4485-a7a8-9816897384ee (8719c4b1-d606-4485-a7a8-9816897384ee): created successfully
Sep 25 15:22:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af12d11e-2061-4f74-8c0f-777be67348c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:22:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Flow 'volume_create_manager' (1841f67f-9761-450a-bbe0-c814c1e924d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:22:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3517810f-a52c-4517-bf8f-9250bcdcb672 tempest-SnapshotDependencyTests-1563551071 None] Created volume successfully.
Sep 25 15:22:57 devstack sudo[107753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b
Sep 25 15:22:57 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:57 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b" returned: 0 in 0.413s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:57 devstack sudo[107758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2 1G
Sep 25 15:22:57 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "cinder-4c96d149-df42-4301-9e8c-9acc0f61b5be-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-4c96d149-df42-4301-9e8c-9acc0f61b5be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "cinder-quobyte-ecb59f9e-3e41-4032-82a8-34e59edaea62" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-quobyte-ecb59f9e-3e41-4032-82a8-34e59edaea62" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "cinder-quobyte-4c96d149-df42-4301-9e8c-9acc0f61b5be" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-quobyte-4c96d149-df42-4301-9e8c-9acc0f61b5be" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Deleting offline snapshot 4c96d149-df42-4301-9e8c-9acc0f61b5be of volume ecb59f9e-3e41-4032-82a8-34e59edaea62 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:22:58 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] snapshot_file for this snap is: volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2 1G" returned: 0 in 0.632s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f4cdb5-3d63-40cb-9cc5-ad95f7b6d89c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:58 devstack sudo[107765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2
Sep 25 15:22:58 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:58 devstack sudo[107766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be
Sep 25 15:22:58 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:58 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2" returned: 0 in 0.361s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:58 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2 is being set with open permissions: ugo+rw
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:58 devstack sudo[107772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2
Sep 25 15:22:58 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:58 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be" returned: 0 in 0.456s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb59f9e-3e41-4032-82a8-34e59edaea62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebeb9908-5203-46e5-a683-6e49a01bfb2e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:22:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:59 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2" returned: 0 in 0.280s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:59 devstack sudo[107777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62
Sep 25 15:22:59 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:59 devstack sudo[107780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.info
Sep 25 15:22:59 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:59 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.info" returned: 0 in 0.310s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:59 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.info is being set with open permissions: ugo+rw
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:59 devstack sudo[107785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.info
Sep 25 15:22:59 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:59 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62" returned: 0 in 0.657s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:59 devstack sudo[107788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be
Sep 25 15:22:59 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:59 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.info" returned: 0 in 0.308s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.425s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.656s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-274206007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3277626-8574-4421-bedb-08c34357ceae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094e5d9665340f0a68e0ebfbe186a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:22:51Z,use_quota=True,user_id='d17eaa9ba46641bd81c36ef1b0184127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Creating volume a3277626-8574-4421-bedb-08c34357ceae {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:22:59 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:22:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a3277626-8574-4421-bedb-08c34357ceae 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:22:59 devstack sudo[107791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a3277626-8574-4421-bedb-08c34357ceae 1073741824
Sep 25 15:22:59 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:22:59 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3cb44850-95a8-420f-a75c-0cfb00e1fa57 tempest-ProjectReaderTests-21771653 None] Create snapshot completed successfully
Sep 25 15:22:59 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be" returned: 0 in 0.435s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:00 devstack sudo[107796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be
Sep 25 15:23:00 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:00 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62.4c96d149-df42-4301-9e8c-9acc0f61b5be" returned: 0 in 0.302s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:00 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a3277626-8574-4421-bedb-08c34357ceae 1073741824" returned: 0 in 0.602s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-quobyte-4c96d149-df42-4301-9e8c-9acc0f61b5be" released by "_delete_snapshot" :: held 1.999s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-quobyte-ecb59f9e-3e41-4032-82a8-34e59edaea62" released by "delete_snapshot" :: held 2.051s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a3277626-8574-4421-bedb-08c34357ceae {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:00 devstack sudo[107802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a3277626-8574-4421-bedb-08c34357ceae
Sep 25 15:23:00 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Created reservations ['a8923bd4-8584-431e-b1ea-67de9b494f7d', '407a4417-48d1-494a-8c2f-c1e8b0a89ca2', 'c007d3b4-78b7-4b0b-814f-bb45b9515547', '232c690f-5300-49be-8d95-7c595efcd9d8'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Delete snapshot completed successfully.
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-a5cf9ddd-52c4-4c5e-93d4-7574b27c0e07 tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-4c96d149-df42-4301-9e8c-9acc0f61b5be-delete_snapshot" released by "delete_snapshot" :: held 2.330s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-483aef02-2faa-4442-acc0-461f576ed3d2-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Lock "cinder-483aef02-2faa-4442-acc0-461f576ed3d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-quobyte-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-quobyte-483aef02-2faa-4442-acc0-461f576ed3d2" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-483aef02-2faa-4442-acc0-461f576ed3d2" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Deleting offline snapshot 483aef02-2faa-4442-acc0-461f576ed3d2 of volume 10cb022c-d71a-4b3b-a14d-8b9ce8cc489b {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] snapshot_file for this snap is: volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c562ea6b-95f7-4fba-b9c3-2014eedbae1c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:00 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a3277626-8574-4421-bedb-08c34357ceae" returned: 0 in 0.492s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc49ed6-a5a0-4bfe-a4e6-b863452813c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3277626-8574-4421-bedb-08c34357ceae', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:00 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199f3fb6-f8e1-439e-8319-db31228b8f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:01 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Volume volume-a3277626-8574-4421-bedb-08c34357ceae (a3277626-8574-4421-bedb-08c34357ceae): created successfully
Sep 25 15:23:01 devstack sudo[107804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2
Sep 25 15:23:01 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199f3fb6-f8e1-439e-8319-db31228b8f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:01 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Flow 'volume_create_manager' (6d0f4bf7-488c-4a2b-9d78-18fc72bc18f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:01 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a2da7e40-cfc1-4891-a808-443cc62d5bd3 tempest-ProjectReaderTests-385189714 None] Created volume successfully.
Sep 25 15:23:01 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2" returned: 0 in 0.461s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:23:01 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6dd00b-70f3-4c80-82ec-e6fae91835aa]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:01 devstack sudo[107810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b
Sep 25 15:23:01 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "cinder-ecb59f9e-3e41-4032-82a8-34e59edaea62-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-ecb59f9e-3e41-4032-82a8-34e59edaea62-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "cinder-quobyte-ecb59f9e-3e41-4032-82a8-34e59edaea62" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-quobyte-ecb59f9e-3e41-4032-82a8-34e59edaea62" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:01 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[541550e1-17b8-437b-b029-fa69b20cdba6]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:01 devstack sudo[107814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62
Sep 25 15:23:01 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:01 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b" returned: 0 in 0.494s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:01 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:01 devstack sudo[107817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2
Sep 25 15:23:01 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Acquiring lock "cinder-a3277626-8574-4421-bedb-08c34357ceae-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Lock "cinder-a3277626-8574-4421-bedb-08c34357ceae-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:02 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62" returned: 0 in 0.497s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:02 devstack sudo[107824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62
Sep 25 15:23:02 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Acquiring lock "cinder-quobyte-a3277626-8574-4421-bedb-08c34357ceae" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Lock "cinder-quobyte-a3277626-8574-4421-bedb-08c34357ceae" acquired by "delete_volume" :: waited 0.036s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87bbf3b-4770-4c56-8dd9-5866accbdaaa]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a3277626-8574-4421-bedb-08c34357ceae {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:02 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2" returned: 0 in 0.584s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:02 devstack sudo[107829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2
Sep 25 15:23:02 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:02 devstack sudo[107828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a3277626-8574-4421-bedb-08c34357ceae
Sep 25 15:23:02 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:02 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ecb59f9e-3e41-4032-82a8-34e59edaea62" returned: 0 in 0.403s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-quobyte-ecb59f9e-3e41-4032-82a8-34e59edaea62" released by "delete_volume" :: held 1.016s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Created reservations ['1c1dbcaa-6e06-46a6-84be-9105eb915ea3', 'f234d229-e00f-450c-a796-c03c373c2903', 'c2885855-c550-4222-90f5-46ba996c8e1c', '57b3c726-88ef-4448-9754-7f937dea4b11'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:02 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a3277626-8574-4421-bedb-08c34357ceae" returned: 0 in 0.524s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:02 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a3277626-8574-4421-bedb-08c34357ceae {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b.483aef02-2faa-4442-acc0-461f576ed3d2" returned: 0 in 0.459s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:02 devstack sudo[107837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a3277626-8574-4421-bedb-08c34357ceae
Sep 25 15:23:02 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-483aef02-2faa-4442-acc0-461f576ed3d2" released by "_delete_snapshot" :: held 2.181s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:02 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b" released by "delete_snapshot" :: held 2.254s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:02 devstack sudo[107839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:23:02 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Created reservations ['29caec82-8374-46e4-88b7-ac614c2cdc29', '699fdf3c-c4fb-409f-9193-573a61b76fab', '8ed786fe-a540-441a-8ab6-be7be1f924ce', 'fe938bd4-fbff-4b25-9588-9c5ac568bab3'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Delete snapshot completed successfully.
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e1142f66-4727-41f9-908d-92aeef14a5af tempest-ProjectReaderTests-21771653 None] Lock "cinder-483aef02-2faa-4442-acc0-461f576ed3d2-delete_snapshot" released by "delete_snapshot" :: held 2.495s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:03 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-a3277626-8574-4421-bedb-08c34357ceae" returned: 0 in 0.384s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Lock "cinder-quobyte-a3277626-8574-4421-bedb-08c34357ceae" released by "delete_volume" :: held 0.980s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Created reservations ['fc234cd0-07f5-4576-a845-8f71e32bb452', '4d63787c-05cf-4c28-a516-610eac2d5645', 'dae1657d-9feb-4d8d-84cd-90f1c3594673', '56c7c11a-25c0-4478-b342-3edb5bb5234f'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:03 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.375s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:23:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Deleted volume successfully.
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-12b21114-ff28-4b42-b136-0fcc4ecd595f tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-ecb59f9e-3e41-4032-82a8-34e59edaea62-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:03 devstack sudo[107843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:23:03 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:03 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.300s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:23:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Deleted volume successfully.
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-ed586d0d-8a1c-45da-bbe7-0dc0924f53ab tempest-ProjectReaderTests-385189714 None] Lock "cinder-a3277626-8574-4421-bedb-08c34357ceae-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "cinder-8719c4b1-d606-4485-a7a8-9816897384ee-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-8719c4b1-d606-4485-a7a8-9816897384ee-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "cinder-quobyte-8719c4b1-d606-4485-a7a8-9816897384ee" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Lock "cinder-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-quobyte-8719c4b1-d606-4485-a7a8-9816897384ee" acquired by "delete_volume" :: waited 0.049s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:04 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f34bf9-f903-410d-8afc-4b0502adc6e4]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8719c4b1-d606-4485-a7a8-9816897384ee {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-quobyte-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:04 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6922d819-1e7b-4db1-879a-9c8df4140600]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:04 devstack sudo[107846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8719c4b1-d606-4485-a7a8-9816897384ee
Sep 25 15:23:04 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:04 devstack sudo[107847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b
Sep 25 15:23:04 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:04 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8719c4b1-d606-4485-a7a8-9816897384ee" returned: 0 in 0.450s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8719c4b1-d606-4485-a7a8-9816897384ee {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:04 devstack sudo[107854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8719c4b1-d606-4485-a7a8-9816897384ee
Sep 25 15:23:04 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:04 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b" returned: 0 in 0.586s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:04 devstack sudo[107859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b
Sep 25 15:23:04 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:04 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-8719c4b1-d606-4485-a7a8-9816897384ee" returned: 0 in 0.431s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-quobyte-8719c4b1-d606-4485-a7a8-9816897384ee" released by "delete_volume" :: held 0.954s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Created reservations ['0c71fcfd-2ef8-4460-a605-ff0c294b8c81', '362dcddb-6fbd-4a92-b67a-3d7fea99624d', '6fb42708-8dde-42ab-8364-537c0a9c6262', 'bd7362f2-a0b7-4061-9f01-cb9a1f0ea662'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Flow 'volume_create_manager' (0ebdbbad-9b50-45a1-8080-0343c515c527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:05 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062ec31e-1124-4900-9e40-c4edc257866b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b" returned: 0 in 0.458s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062ec31e-1124-4900-9e40-c4edc257866b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232815301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8815b8-c998-41e4-b661-d5643eca16a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094e5d9665340f0a68e0ebfbe186a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:23:05Z,use_quota=True,user_id='d17eaa9ba46641bd81c36ef1b0184127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776650b2-7661-47e3-ab19-a9e3124f8713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776650b2-7661-47e3-ab19-a9e3124f8713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c19a0bc-d4ea-4e1a-baf5-8d40abbc3b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c19a0bc-d4ea-4e1a-baf5-8d40abbc3b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d8815b8-c998-41e4-b661-d5643eca16a7', 'volume_name': 'volume-4d8815b8-c998-41e4-b661-d5643eca16a7', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1ea4df-32ba-4b36-adf8-11a6ff0ce496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1ea4df-32ba-4b36-adf8-11a6ff0ce496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ad6c07-d16c-4676-ab2c-e0d62be03370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:05 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Volume 4d8815b8-c998-41e4-b661-d5643eca16a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d8815b8-c998-41e4-b661-d5643eca16a7', 'volume_size': 1}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232815301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8815b8-c998-41e4-b661-d5643eca16a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094e5d9665340f0a68e0ebfbe186a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:23:05Z,use_quota=True,user_id='d17eaa9ba46641bd81c36ef1b0184127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Creating volume 4d8815b8-c998-41e4-b661-d5643eca16a7 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:23:05 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4d8815b8-c998-41e4-b661-d5643eca16a7 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b" released by "delete_volume" :: held 1.230s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:05 devstack sudo[107863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4d8815b8-c998-41e4-b661-d5643eca16a7 1073741824
Sep 25 15:23:05 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Created reservations ['2a3580d8-a7a0-46c9-86cc-ab440afb3d1e', '8ee58fae-c7a9-4913-a582-6b7d00419b0f', 'a9440169-623e-4bfb-a112-b1325e2d7767', '37862bf1-cd41-4d7f-870e-ac96f250ca6b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:05 devstack sudo[107865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:23:05 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:05 devstack sudo[107867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:23:05 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:05 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.413s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:23:05 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Deleted volume successfully.
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-b736042b-c82b-42e2-9e39-67e814391c93 tempest-SnapshotDependencyTests-1563551071 None] Lock "cinder-8719c4b1-d606-4485-a7a8-9816897384ee-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:05 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4d8815b8-c998-41e4-b661-d5643eca16a7 1073741824" returned: 0 in 0.656s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:05 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.388s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:05 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:23:05 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Deleted volume successfully.
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4d8815b8-c998-41e4-b661-d5643eca16a7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-41f4bc1e-bcec-4701-8f46-fe73def61046 tempest-ProjectReaderTests-21771653 None] Lock "cinder-10cb022c-d71a-4b3b-a14d-8b9ce8cc489b-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:06 devstack sudo[107876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4d8815b8-c998-41e4-b661-d5643eca16a7
Sep 25 15:23:06 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:06 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4d8815b8-c998-41e4-b661-d5643eca16a7" returned: 0 in 0.349s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ad6c07-d16c-4676-ab2c-e0d62be03370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d8815b8-c998-41e4-b661-d5643eca16a7', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7b2d61-517a-42fc-aaf9-72e3fafae65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:06 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Volume volume-4d8815b8-c998-41e4-b661-d5643eca16a7 (4d8815b8-c998-41e4-b661-d5643eca16a7): created successfully
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7b2d61-517a-42fc-aaf9-72e3fafae65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Flow 'volume_create_manager' (0ebdbbad-9b50-45a1-8080-0343c515c527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (24c2b614-bcdb-4aed-bf8f-b708dfa06282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4094c5-355f-4305-bcc9-ba52c37b1218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:06 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e180968f-7534-4b16-8b69-9afd458b6454 tempest-ProjectReaderTests-385189714 None] Created volume successfully.
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4094c5-355f-4305-bcc9-ba52c37b1218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760806646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf34840-0e09-4a47-bd01-875ac3d20c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:23:06Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a45f618-e5e8-4d21-bd40-a86ffefa9f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a45f618-e5e8-4d21-bd40-a86ffefa9f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd212e7-5ebd-4cb8-854e-81f13c9e402c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd212e7-5ebd-4cb8-854e-81f13c9e402c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cf34840-0e09-4a47-bd01-875ac3d20c96', 'volume_name': 'volume-9cf34840-0e09-4a47-bd01-875ac3d20c96', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c868b6f-8d5e-49a1-b22f-bcd476465314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c868b6f-8d5e-49a1-b22f-bcd476465314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28198571-664b-4a1f-9f97-435f8fc8960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:06 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Volume 9cf34840-0e09-4a47-bd01-875ac3d20c96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cf34840-0e09-4a47-bd01-875ac3d20c96', 'volume_size': 1}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760806646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf34840-0e09-4a47-bd01-875ac3d20c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:23:06Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Creating volume 9cf34840-0e09-4a47-bd01-875ac3d20c96 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:23:06 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:23:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:06 devstack sudo[107879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96 1073741824
Sep 25 15:23:06 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Flow 'volume_create_manager' (dfcff937-4588-48b2-9e13-725e8db06b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b122b5-ebdb-4328-a736-b16c28b6a13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b122b5-ebdb-4328-a736-b16c28b6a13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2073807692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05cee04-9a44-476b-8f60-d295b5f9e3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06322166606245ae9d97610679e2ce30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:23:07Z,use_quota=True,user_id='9de10c7c009846479fbca2cb58cc032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c50f832-cc43-43a5-acbb-7395ab40c5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c50f832-cc43-43a5-acbb-7395ab40c5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba27b531-1bd8-4798-8b78-ea392bbdfe82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba27b531-1bd8-4798-8b78-ea392bbdfe82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b05cee04-9a44-476b-8f60-d295b5f9e3bd', 'volume_name': 'volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63f4228-c80a-4280-b23f-6b96d8ec4237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63f4228-c80a-4280-b23f-6b96d8ec4237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4ba422-9505-4097-a7f3-b93c1e89af10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:07 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Volume b05cee04-9a44-476b-8f60-d295b5f9e3bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd', 'volume_size': 1}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Acquiring lock "cinder-4d8815b8-c998-41e4-b661-d5643eca16a7-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Lock "cinder-4d8815b8-c998-41e4-b661-d5643eca16a7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Acquiring lock "cinder-quobyte-4d8815b8-c998-41e4-b661-d5643eca16a7" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Lock "cinder-quobyte-4d8815b8-c998-41e4-b661-d5643eca16a7" acquired by "delete_volume" :: waited 0.028s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:07 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96 1073741824" returned: 0 in 0.730s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[db33c6b6-fe40-42c7-8d4f-bc18dcc0145f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4d8815b8-c998-41e4-b661-d5643eca16a7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:07 devstack sudo[107886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96
Sep 25 15:23:07 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:07 devstack sudo[107885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4d8815b8-c998-41e4-b661-d5643eca16a7
Sep 25 15:23:07 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:07 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96" returned: 0 in 0.329s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2073807692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05cee04-9a44-476b-8f60-d295b5f9e3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06322166606245ae9d97610679e2ce30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:23:07Z,use_quota=True,user_id='9de10c7c009846479fbca2cb58cc032a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Creating volume b05cee04-9a44-476b-8f60-d295b5f9e3bd {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:23:07 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:07 devstack sudo[107892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd 1073741824
Sep 25 15:23:07 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28198571-664b-4a1f-9f97-435f8fc8960c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cf34840-0e09-4a47-bd01-875ac3d20c96', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feba9fbf-429b-4c64-b217-51980b1932db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:07 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Volume volume-9cf34840-0e09-4a47-bd01-875ac3d20c96 (9cf34840-0e09-4a47-bd01-875ac3d20c96): created successfully
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feba9fbf-429b-4c64-b217-51980b1932db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (24c2b614-bcdb-4aed-bf8f-b708dfa06282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:07 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4d8815b8-c998-41e4-b661-d5643eca16a7" returned: 0 in 0.529s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4d8815b8-c998-41e4-b661-d5643eca16a7 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:07 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d416ebc3-05fc-4afa-adf1-ae567a6a94f9 tempest-ProjectMemberTests-200391913 None] Created volume successfully.
Sep 25 15:23:07 devstack sudo[107895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4d8815b8-c998-41e4-b661-d5643eca16a7
Sep 25 15:23:07 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:08 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-4d8815b8-c998-41e4-b661-d5643eca16a7" returned: 0 in 0.294s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Lock "cinder-quobyte-4d8815b8-c998-41e4-b661-d5643eca16a7" released by "delete_volume" :: held 0.883s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Created reservations ['94d8854d-7ca1-4ac6-a855-589346cfb1d4', '47881a26-e4f3-4f39-9c0c-8eb38482ef6f', 'a23bed39-0b69-4eb9-9ada-64cb5283ec19', '660dfae0-c4cf-47d5-b9be-b26dd357e5cd'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:08 devstack sudo[107903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:23:08 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:08 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd 1073741824" returned: 0 in 0.625s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:08 devstack sudo[107905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd
Sep 25 15:23:08 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:08 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.347s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:23:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Deleted volume successfully.
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-8f7e92d0-67cc-4f80-a335-bd66c9924960 tempest-ProjectReaderTests-385189714 None] Lock "cinder-4d8815b8-c998-41e4-b661-d5643eca16a7-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:08 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd" returned: 0 in 0.434s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4ba422-9505-4097-a7f3-b93c1e89af10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b5c977-e220-4c16-b846-ff94f82e81d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:08 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Volume volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd (b05cee04-9a44-476b-8f60-d295b5f9e3bd): created successfully
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b5c977-e220-4c16-b846-ff94f82e81d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:08 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Flow 'volume_create_manager' (dfcff937-4588-48b2-9e13-725e8db06b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:09 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-b5a49a38-8eaa-4c4c-ad59-8463183d835c tempest-ProjectReaderTests-21771653 None] Created volume successfully.
Sep 25 15:23:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] Creating offline snapshot 8c7ccd43-9f03-435f-b563-13eec4c4025f of volume 9cf34840-0e09-4a47-bd01-875ac3d20c96 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:23:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0672b69-9b43-4457-a708-14f80a2be109]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:09 devstack sudo[107910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96
Sep 25 15:23:09 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:09 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96" returned: 0 in 0.450s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:09 devstack sudo[107915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f 1G
Sep 25 15:23:09 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:10 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f 1G" returned: 0 in 0.519s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cf34840-0e09-4a47-bd01-875ac3d20c96 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:10 devstack sudo[107921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cf34840-0e09-4a47-bd01-875ac3d20c96 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f
Sep 25 15:23:10 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:10 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cf34840-0e09-4a47-bd01-875ac3d20c96 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f" returned: 0 in 0.332s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:10 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f is being set with open permissions: ugo+rw
Sep 25 15:23:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:10 devstack sudo[107926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f
Sep 25 15:23:10 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:10 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f" returned: 0 in 0.286s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:10 devstack sudo[107929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.info
Sep 25 15:23:10 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:11 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.info" returned: 0 in 0.274s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:11 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.info is being set with open permissions: ugo+rw
Sep 25 15:23:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:11 devstack sudo[107932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.info
Sep 25 15:23:11 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:11 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.info" returned: 0 in 0.337s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.336s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.089s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:11 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] Creating offline snapshot 42e9ba50-003d-47f0-8c2b-b8e4ae229bbd of volume b05cee04-9a44-476b-8f60-d295b5f9e3bd {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:23:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-8d97d147-b527-4f70-b922-35bf5306f6e2 tempest-ProjectMemberTests-200391913 None] Create snapshot completed successfully
Sep 25 15:23:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe9c68-a40e-43fa-b0f1-ce0f05221d6f]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:11 devstack sudo[107935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd
Sep 25 15:23:11 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:11 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd" returned: 0 in 0.441s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:11 devstack sudo[107940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd 1G
Sep 25 15:23:11 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-8c7ccd43-9f03-435f-b563-13eec4c4025f-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Lock "cinder-8c7ccd43-9f03-435f-b563-13eec4c4025f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-9cf34840-0e09-4a47-bd01-875ac3d20c96" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-9cf34840-0e09-4a47-bd01-875ac3d20c96" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-8c7ccd43-9f03-435f-b563-13eec4c4025f" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-8c7ccd43-9f03-435f-b563-13eec4c4025f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Deleting offline snapshot 8c7ccd43-9f03-435f-b563-13eec4c4025f of volume 9cf34840-0e09-4a47-bd01-875ac3d20c96 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:23:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] snapshot_file for this snap is: volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:23:12 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e4397c-fa0f-4a9d-becc-63c113495a2c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:12 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd 1G" returned: 0 in 0.638s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:12 devstack sudo[107947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f
Sep 25 15:23:12 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:12 devstack sudo[107948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd
Sep 25 15:23:12 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:12 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd" returned: 0 in 0.374s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:12 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd is being set with open permissions: ugo+rw
Sep 25 15:23:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:12 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f" returned: 0 in 0.519s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cf34840-0e09-4a47-bd01-875ac3d20c96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:23:13 devstack sudo[107957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd
Sep 25 15:23:13 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:13 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c27af39-b4c6-46e2-a25e-adb87395091e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:13 devstack sudo[107959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96
Sep 25 15:23:13 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:13 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd" returned: 0 in 0.298s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:13 devstack sudo[107962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.info
Sep 25 15:23:13 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:13 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96" returned: 0 in 0.518s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:13 devstack sudo[107967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f
Sep 25 15:23:13 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:13 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.info" returned: 0 in 0.357s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:13 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.info is being set with open permissions: ugo+rw
Sep 25 15:23:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:13 devstack sudo[107970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.info
Sep 25 15:23:13 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:13 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.info" returned: 0 in 0.278s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:13 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f" returned: 0 in 0.442s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c670acbe-052e-4b73-998c-028cf53e4e24 tempest-ProjectReaderTests-21771653 None] Create snapshot completed successfully
Sep 25 15:23:14 devstack sudo[108010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f
Sep 25 15:23:14 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:14 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96.8c7ccd43-9f03-435f-b563-13eec4c4025f" returned: 0 in 0.348s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-8c7ccd43-9f03-435f-b563-13eec4c4025f" released by "_delete_snapshot" :: held 1.974s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-9cf34840-0e09-4a47-bd01-875ac3d20c96" released by "delete_snapshot" :: held 2.006s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:14 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Created reservations ['80c990f7-5448-4d7d-b660-aa56a673c9f9', '3aea90a2-0ef6-487f-ad5b-91873bf712d3', '94e971a4-1978-4301-bb17-41c8a82afcbf', '5dbbbca2-6db0-45aa-9f9a-64743726429b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Delete snapshot completed successfully.
Sep 25 15:23:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-f4ed3aab-bd0d-4cbf-883c-47c114fb3c5b tempest-ProjectMemberTests-200391913 None] Lock "cinder-8c7ccd43-9f03-435f-b563-13eec4c4025f-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-42e9ba50-003d-47f0-8c2b-b8e4ae229bbd-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Lock "cinder-42e9ba50-003d-47f0-8c2b-b8e4ae229bbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-quobyte-b05cee04-9a44-476b-8f60-d295b5f9e3bd" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-b05cee04-9a44-476b-8f60-d295b5f9e3bd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-quobyte-42e9ba50-003d-47f0-8c2b-b8e4ae229bbd" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:14 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-42e9ba50-003d-47f0-8c2b-b8e4ae229bbd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Deleting offline snapshot 42e9ba50-003d-47f0-8c2b-b8e4ae229bbd of volume b05cee04-9a44-476b-8f60-d295b5f9e3bd {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:23:14 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] snapshot_file for this snap is: volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:23:14 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2792d31f-b8e1-4908-a83d-25d203720f27]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:14 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:14 devstack sudo[108016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd
Sep 25 15:23:14 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:15 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd" returned: 0 in 0.428s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:23:15 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1035379-154f-4ce5-ae27-716f6eda98ad]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:15 devstack sudo[108021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd
Sep 25 15:23:15 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-9cf34840-0e09-4a47-bd01-875ac3d20c96-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Lock "cinder-9cf34840-0e09-4a47-bd01-875ac3d20c96-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:15 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-9cf34840-0e09-4a47-bd01-875ac3d20c96" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd" returned: 0 in 0.496s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:15 devstack sudo[108026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd
Sep 25 15:23:15 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:15 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-9cf34840-0e09-4a47-bd01-875ac3d20c96" acquired by "delete_volume" :: waited 0.039s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:15 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[391c8810-de5e-4507-a17d-5da415629516]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:15 devstack sudo[108028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96
Sep 25 15:23:15 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:16 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd" returned: 0 in 0.395s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:16 devstack sudo[108033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd
Sep 25 15:23:16 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:16 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96" returned: 0 in 0.445s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:16 devstack sudo[108038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96
Sep 25 15:23:16 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:16 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd.42e9ba50-003d-47f0-8c2b-b8e4ae229bbd" returned: 0 in 0.283s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-42e9ba50-003d-47f0-8c2b-b8e4ae229bbd" released by "_delete_snapshot" :: held 1.735s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-b05cee04-9a44-476b-8f60-d295b5f9e3bd" released by "delete_snapshot" :: held 1.760s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=235,cinder:SELECT=175,cinder:DELETE=19,cinder:INSERT=60 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:23:16 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-9cf34840-0e09-4a47-bd01-875ac3d20c96" returned: 0 in 0.289s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-9cf34840-0e09-4a47-bd01-875ac3d20c96" released by "delete_volume" :: held 0.810s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Created reservations ['b504ad37-5c49-4dae-8cc6-bece455eb67c', '13d2f5df-8567-4b56-87c7-f67a64d5e90b', '2b3f6bd4-c19d-4371-ae17-7b96369dbc45', '84a9ad57-1dce-4cd9-ba6b-e2fb71b1d687'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:16 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Delete snapshot completed successfully.
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5906f287-1fda-49e8-b868-46512ea70de6 tempest-ProjectReaderTests-21771653 None] Lock "cinder-42e9ba50-003d-47f0-8c2b-b8e4ae229bbd-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Created reservations ['2db7b461-9012-447a-a0ce-00548555d6fc', 'c66f1fed-e51e-4173-9a06-1b142d178819', '1b18ffff-89a4-469d-96a7-ef0bfd8957c4', '63c7f1e9-5134-49b4-b6bd-b22442aff39a'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:16 devstack sudo[108042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:23:16 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-b05cee04-9a44-476b-8f60-d295b5f9e3bd-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:16 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Lock "cinder-b05cee04-9a44-476b-8f60-d295b5f9e3bd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Acquiring lock "cinder-quobyte-b05cee04-9a44-476b-8f60-d295b5f9e3bd" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-b05cee04-9a44-476b-8f60-d295b5f9e3bd" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:17 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8abb315-aabf-4420-921f-27f8028244b2]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:17 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.323s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:17 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:23:17 devstack sudo[108044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd
Sep 25 15:23:17 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Deleted volume successfully.
Sep 25 15:23:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5e65c6df-fc81-4859-9f22-eee08f2a50a3 tempest-ProjectMemberTests-200391913 None] Lock "cinder-9cf34840-0e09-4a47-bd01-875ac3d20c96-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:17 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd" returned: 0 in 0.485s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:17 devstack sudo[108050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd
Sep 25 15:23:17 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:17 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-b05cee04-9a44-476b-8f60-d295b5f9e3bd" returned: 0 in 0.303s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:17 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Lock "cinder-quobyte-b05cee04-9a44-476b-8f60-d295b5f9e3bd" released by "delete_volume" :: held 0.886s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Created reservations ['91e79802-4cbf-458a-8404-139e500c8671', 'f89ee19d-ed5f-4d31-aeec-f0498018f867', '0f67f56e-7cef-410f-bb21-e4b60e630640', '896acb20-16c7-4f35-9a3a-6d7f2f3502ab'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:18 devstack sudo[108055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:23:18 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:18 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.402s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:23:18 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Deleted volume successfully.
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d770d5af-0eb8-4d80-a8e6-afe33a830ebf tempest-ProjectReaderTests-21771653 None] Lock "cinder-b05cee04-9a44-476b-8f60-d295b5f9e3bd-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (b2ee6ec8-a3dc-49da-ad7b-e54a177fb47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a574099-4407-4485-93a9-4e62dd3ac21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a574099-4407-4485-93a9-4e62dd3ac21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1086303985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4a4dca-71dd-4297-a6fe-532843390bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:23:19Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7700624-fc41-4282-a2be-5dbdf88ceb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7700624-fc41-4282-a2be-5dbdf88ceb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89fa205c-3d59-476c-b82b-8faf74198dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89fa205c-3d59-476c-b82b-8faf74198dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e4a4dca-71dd-4297-a6fe-532843390bb9', 'volume_name': 'volume-3e4a4dca-71dd-4297-a6fe-532843390bb9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c3e7a6-8009-4bf3-95df-aff6e9bd5077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c3e7a6-8009-4bf3-95df-aff6e9bd5077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62ec4fe-5441-4db1-8ab2-c5d4f3f10e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:18 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Volume 3e4a4dca-71dd-4297-a6fe-532843390bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e4a4dca-71dd-4297-a6fe-532843390bb9', 'volume_size': 1}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1086303985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4a4dca-71dd-4297-a6fe-532843390bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:23:19Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Creating volume 3e4a4dca-71dd-4297-a6fe-532843390bb9 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:23:18 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:23:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:18 devstack sudo[108058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9 1073741824
Sep 25 15:23:18 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:19 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9 1073741824" returned: 0 in 0.634s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:19 devstack sudo[108064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9
Sep 25 15:23:19 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:20 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9" returned: 0 in 0.385s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:23:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62ec4fe-5441-4db1-8ab2-c5d4f3f10e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e4a4dca-71dd-4297-a6fe-532843390bb9', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e7643b-0192-4129-b875-98e271b089b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:20 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Volume volume-3e4a4dca-71dd-4297-a6fe-532843390bb9 (3e4a4dca-71dd-4297-a6fe-532843390bb9): created successfully
Sep 25 15:23:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e7643b-0192-4129-b875-98e271b089b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:20 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (b2ee6ec8-a3dc-49da-ad7b-e54a177fb47a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:20 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d78ef238-3a29-4982-9726-c594ec11837a tempest-ProjectMemberTests-200391913 None] Created volume successfully.
Sep 25 15:23:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:23:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:21 devstack sudo[108067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:23:21 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] Creating offline snapshot 5524d516-c1b0-4ab8-8020-e3be85b289c9 of volume 3e4a4dca-71dd-4297-a6fe-532843390bb9 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:23:21 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35480f2-5cce-4f5d-88fa-eceacfe9b808]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:21 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.382s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:23:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:23:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 29 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:23:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>, <Thread(Rabbit-heartbeat, started daemon 129983531771584)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:23:21 devstack sudo[108069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9
Sep 25 15:23:21 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:21 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9" returned: 0 in 0.473s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:21 devstack sudo[108075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9 1G
Sep 25 15:23:21 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:22 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9 1G" returned: 0 in 0.480s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4a4dca-71dd-4297-a6fe-532843390bb9 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:22 devstack sudo[108080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4a4dca-71dd-4297-a6fe-532843390bb9 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9
Sep 25 15:23:22 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:22 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4a4dca-71dd-4297-a6fe-532843390bb9 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9" returned: 0 in 0.324s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:22 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9 is being set with open permissions: ugo+rw
Sep 25 15:23:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:22 devstack sudo[108086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9
Sep 25 15:23:22 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:22 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9" returned: 0 in 0.269s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:22 devstack sudo[108089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.info
Sep 25 15:23:22 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:23 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.info" returned: 0 in 0.289s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:23 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.info is being set with open permissions: ugo+rw
Sep 25 15:23:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:23 devstack sudo[108092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.info
Sep 25 15:23:23 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:23 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.info" returned: 0 in 0.265s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-259cf7c0-7be4-472a-a141-d8aca8e43578 tempest-ProjectMemberTests-200391913 None] Create snapshot completed successfully
Sep 25 15:23:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-5524d516-c1b0-4ab8-8020-e3be85b289c9-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Lock "cinder-5524d516-c1b0-4ab8-8020-e3be85b289c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-3e4a4dca-71dd-4297-a6fe-532843390bb9" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-3e4a4dca-71dd-4297-a6fe-532843390bb9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-5524d516-c1b0-4ab8-8020-e3be85b289c9" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:24 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-5524d516-c1b0-4ab8-8020-e3be85b289c9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Deleting offline snapshot 5524d516-c1b0-4ab8-8020-e3be85b289c9 of volume 3e4a4dca-71dd-4297-a6fe-532843390bb9 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:23:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] snapshot_file for this snap is: volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:23:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9970168-f0ce-4257-b445-9ccfc3a1e45e]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:24 devstack sudo[108095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9
Sep 25 15:23:24 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:24 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9" returned: 0 in 0.439s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e4a4dca-71dd-4297-a6fe-532843390bb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:23:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4763745-a8b5-4fb8-aa8e-73f3c5d3b555]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:25 devstack sudo[108100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9
Sep 25 15:23:25 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:25 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9" returned: 0 in 0.410s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:25 devstack sudo[108105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9
Sep 25 15:23:25 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:25 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9" returned: 0 in 0.373s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:25 devstack sudo[108110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9
Sep 25 15:23:25 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:25 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9.5524d516-c1b0-4ab8-8020-e3be85b289c9" returned: 0 in 0.258s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-5524d516-c1b0-4ab8-8020-e3be85b289c9" released by "_delete_snapshot" :: held 1.615s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-3e4a4dca-71dd-4297-a6fe-532843390bb9" released by "delete_snapshot" :: held 1.641s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:26 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Created reservations ['2edc8df4-bf80-4075-9ed9-710cfbe72577', 'b651a2f9-eea9-4e43-9d0a-61344b5f5449', '113bb95b-17bd-4ba8-b295-887f903278b1', 'fe5e6780-ae61-4bd2-999c-70051e562e9b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Delete snapshot completed successfully.
Sep 25 15:23:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1ac74ef3-78b5-40fb-9338-ef122a6d847b tempest-ProjectMemberTests-200391913 None] Lock "cinder-5524d516-c1b0-4ab8-8020-e3be85b289c9-delete_snapshot" released by "delete_snapshot" :: held 1.794s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-3e4a4dca-71dd-4297-a6fe-532843390bb9-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Lock "cinder-3e4a4dca-71dd-4297-a6fe-532843390bb9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-3e4a4dca-71dd-4297-a6fe-532843390bb9" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:26 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-3e4a4dca-71dd-4297-a6fe-532843390bb9" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:26 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a187d512-38fc-4a03-bb26-dd80c90432f2]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:26 devstack sudo[108113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9
Sep 25 15:23:26 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:27 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9" returned: 0 in 0.404s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:27 devstack sudo[108118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9
Sep 25 15:23:27 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:27 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-3e4a4dca-71dd-4297-a6fe-532843390bb9" returned: 0 in 0.278s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-3e4a4dca-71dd-4297-a6fe-532843390bb9" released by "delete_volume" :: held 0.748s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:27 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Created reservations ['69a6a434-f78c-4767-b7ea-41c6799781b7', '35a0788d-e733-4ff7-8a93-204b956ad058', 'cf57279d-8ab1-49d1-8a16-8b23ec681c44', '7ce881dd-5cfa-453a-9225-96070c3586e1'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:27 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:27 devstack sudo[108121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:23:27 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:27 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:27 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.268s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:27 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:23:27 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Deleted volume successfully.
Sep 25 15:23:27 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0e176761-ba32-458d-b171-8cba9403500a tempest-ProjectMemberTests-200391913 None] Lock "cinder-3e4a4dca-71dd-4297-a6fe-532843390bb9-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (8f85e82e-e36c-4d34-af7e-0d8d603057eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3d35df-1189-4016-b8d3-bdcae9efe9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3d35df-1189-4016-b8d3-bdcae9efe9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1557448970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95acc7ab-664c-4c97-9202-616a1790cfe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:23:28Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b031c79-cad3-476d-8426-04b608b2e2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b031c79-cad3-476d-8426-04b608b2e2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16637454-d906-466c-a8f4-54221334264e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16637454-d906-466c-a8f4-54221334264e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95acc7ab-664c-4c97-9202-616a1790cfe3', 'volume_name': 'volume-95acc7ab-664c-4c97-9202-616a1790cfe3', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8292c4e-3f51-4dae-aac8-a68287c3d176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8292c4e-3f51-4dae-aac8-a68287c3d176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7675d7b-dace-4e1e-be0d-91e50095a0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:28 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Volume 95acc7ab-664c-4c97-9202-616a1790cfe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95acc7ab-664c-4c97-9202-616a1790cfe3', 'volume_size': 1}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1557448970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95acc7ab-664c-4c97-9202-616a1790cfe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:23:28Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Creating volume 95acc7ab-664c-4c97-9202-616a1790cfe3 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:23:28 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:28 devstack sudo[108125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3 1073741824
Sep 25 15:23:28 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:28 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3 1073741824" returned: 0 in 0.496s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:28 devstack sudo[108130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3
Sep 25 15:23:28 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:29 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3" returned: 0 in 0.287s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:29 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:23:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7675d7b-dace-4e1e-be0d-91e50095a0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95acc7ab-664c-4c97-9202-616a1790cfe3', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbc2dc7-06f8-4a67-987d-478ea5dab54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:29 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Volume volume-95acc7ab-664c-4c97-9202-616a1790cfe3 (95acc7ab-664c-4c97-9202-616a1790cfe3): created successfully
Sep 25 15:23:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbc2dc7-06f8-4a67-987d-478ea5dab54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:29 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (8f85e82e-e36c-4d34-af7e-0d8d603057eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-641e0842-b7cb-471f-8b4d-dd05d803042c tempest-ProjectMemberTests-200391913 None] Created volume successfully.
Sep 25 15:23:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:30 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] Creating offline snapshot 33cf3490-9e6d-48b2-ab02-9b572aca8fdb of volume 95acc7ab-664c-4c97-9202-616a1790cfe3 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:23:30 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78d2783-6190-452c-910f-13cdba06e921]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:30 devstack sudo[108133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3
Sep 25 15:23:30 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:30 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3" returned: 0 in 0.391s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:31 devstack sudo[108138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb 1G
Sep 25 15:23:31 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:31 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb 1G" returned: 0 in 0.464s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95acc7ab-664c-4c97-9202-616a1790cfe3 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:31 devstack sudo[108143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95acc7ab-664c-4c97-9202-616a1790cfe3 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb
Sep 25 15:23:31 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:31 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95acc7ab-664c-4c97-9202-616a1790cfe3 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb" returned: 0 in 0.325s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:31 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb is being set with open permissions: ugo+rw
Sep 25 15:23:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:31 devstack sudo[108148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb
Sep 25 15:23:31 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:32 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb" returned: 0 in 0.240s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:32 devstack sudo[108151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.info
Sep 25 15:23:32 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:32 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.info" returned: 0 in 0.256s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:32 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.info is being set with open permissions: ugo+rw
Sep 25 15:23:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:32 devstack sudo[108154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.info
Sep 25 15:23:32 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:32 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.info" returned: 0 in 0.268s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:32 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:32 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d0944522-626a-44af-b770-7e17fa3eaf1b tempest-ProjectMemberTests-200391913 None] Create snapshot completed successfully
Sep 25 15:23:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-33cf3490-9e6d-48b2-ab02-9b572aca8fdb-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Lock "cinder-33cf3490-9e6d-48b2-ab02-9b572aca8fdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-95acc7ab-664c-4c97-9202-616a1790cfe3" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-95acc7ab-664c-4c97-9202-616a1790cfe3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-33cf3490-9e6d-48b2-ab02-9b572aca8fdb" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:33 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-33cf3490-9e6d-48b2-ab02-9b572aca8fdb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Deleting offline snapshot 33cf3490-9e6d-48b2-ab02-9b572aca8fdb of volume 95acc7ab-664c-4c97-9202-616a1790cfe3 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:23:33 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] snapshot_file for this snap is: volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:23:33 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fbddef-f7bb-490d-a34c-3a37fd8ab845]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:33 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:33 devstack sudo[108158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb
Sep 25 15:23:33 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:34 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb" returned: 0 in 0.390s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:34 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95acc7ab-664c-4c97-9202-616a1790cfe3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:23:34 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[addf00f7-8520-4d90-9b33-e10d1d438f70]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:34 devstack sudo[108163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3
Sep 25 15:23:34 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:34 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3" returned: 0 in 0.399s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:34 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:34 devstack sudo[108168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb
Sep 25 15:23:34 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:35 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb" returned: 0 in 0.409s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:35 devstack sudo[108174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb
Sep 25 15:23:35 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:35 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:35 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3.33cf3490-9e6d-48b2-ab02-9b572aca8fdb" returned: 0 in 0.281s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-33cf3490-9e6d-48b2-ab02-9b572aca8fdb" released by "_delete_snapshot" :: held 1.602s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-95acc7ab-664c-4c97-9202-616a1790cfe3" released by "delete_snapshot" :: held 1.629s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:35 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Created reservations ['f8fb2474-f200-4293-a2f1-94edbfc1f2f9', '273c3861-70f1-4fab-a64d-c0e9cd92a4d6', '486b8d33-da89-4d24-9a02-df808f1bbf2a', '085b3e9a-7850-451c-9381-717a1455df78'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:35 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Delete snapshot completed successfully.
Sep 25 15:23:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-0918fcc8-aed9-44bf-a988-097fe549b21b tempest-ProjectMemberTests-200391913 None] Lock "cinder-33cf3490-9e6d-48b2-ab02-9b572aca8fdb-delete_snapshot" released by "delete_snapshot" :: held 1.823s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-95acc7ab-664c-4c97-9202-616a1790cfe3-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:35 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Lock "cinder-95acc7ab-664c-4c97-9202-616a1790cfe3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-95acc7ab-664c-4c97-9202-616a1790cfe3" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-95acc7ab-664c-4c97-9202-616a1790cfe3" acquired by "delete_volume" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:36 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddf3d22-7fa9-49ac-8ed8-426fe0f18f56]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:36 devstack sudo[108177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3
Sep 25 15:23:36 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:36 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3" returned: 0 in 0.404s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:36 devstack sudo[108182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3
Sep 25 15:23:36 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:36 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-95acc7ab-664c-4c97-9202-616a1790cfe3" returned: 0 in 0.292s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:36 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-95acc7ab-664c-4c97-9202-616a1790cfe3" released by "delete_volume" :: held 0.771s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:36 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Created reservations ['81f7955c-0064-45b0-86dc-a1ededa0b1f4', 'afb7da2f-90f8-4d02-b7fb-c8dcf6030df3', 'c88daab2-7732-4dbb-a56b-54b6ecd0d4e8', '1b0f9ebf-56c5-4c87-b8ab-844e4e014c7c'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:36 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:36 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:36 devstack sudo[108185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:23:36 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:37 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.273s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:23:37 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Deleted volume successfully.
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-c8b359c3-9918-4470-8033-27095b4cf1f4 tempest-ProjectMemberTests-200391913 None] Lock "cinder-95acc7ab-664c-4c97-9202-616a1790cfe3-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (ada26f30-4be9-4646-ac06-f6dd664f8e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd32445-2e27-4cae-aa7d-a90f2f3551f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd32445-2e27-4cae-aa7d-a90f2f3551f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-586749342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5566c89-b94d-4c7d-b003-672527fcb533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:23:38Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde4fe0e-c181-41d1-9541-4131b92b0a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde4fe0e-c181-41d1-9541-4131b92b0a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3eba036-37d6-4d6b-8ac0-7258ec12cc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3eba036-37d6-4d6b-8ac0-7258ec12cc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5566c89-b94d-4c7d-b003-672527fcb533', 'volume_name': 'volume-e5566c89-b94d-4c7d-b003-672527fcb533', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c212e0f3-39e9-4f0a-94d9-d3c191ec897f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c212e0f3-39e9-4f0a-94d9-d3c191ec897f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c41adbc-b927-4040-8abf-89775e0131bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:37 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Volume e5566c89-b94d-4c7d-b003-672527fcb533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5566c89-b94d-4c7d-b003-672527fcb533', 'volume_size': 1}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-586749342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5566c89-b94d-4c7d-b003-672527fcb533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:23:38Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Creating volume e5566c89-b94d-4c7d-b003-672527fcb533 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:23:37 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:23:37 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:37 devstack sudo[108188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533 1073741824
Sep 25 15:23:37 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:38 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533 1073741824" returned: 0 in 0.463s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:38 devstack sudo[108195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533
Sep 25 15:23:38 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:38 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533" returned: 0 in 0.288s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:38 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:23:38 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c41adbc-b927-4040-8abf-89775e0131bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5566c89-b94d-4c7d-b003-672527fcb533', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbaa001-d563-460c-960e-ed74f2acb56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:38 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Volume volume-e5566c89-b94d-4c7d-b003-672527fcb533 (e5566c89-b94d-4c7d-b003-672527fcb533): created successfully
Sep 25 15:23:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbaa001-d563-460c-960e-ed74f2acb56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:38 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (ada26f30-4be9-4646-ac06-f6dd664f8e6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:39 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e26a239a-54e0-4708-b349-afabce4df89c tempest-ProjectMemberTests-200391913 None] Created volume successfully.
Sep 25 15:23:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:39 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] Creating offline snapshot 77d3bb96-4e55-4bcc-a5aa-01503be70faf of volume e5566c89-b94d-4c7d-b003-672527fcb533 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:23:39 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38433a5-b44c-4ccf-b5b1-6656e624c305]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:39 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:40 devstack sudo[108198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533
Sep 25 15:23:40 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:40 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533" returned: 0 in 0.422s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:40 devstack sudo[108203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf 1G
Sep 25 15:23:40 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:40 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf 1G" returned: 0 in 0.443s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:40 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5566c89-b94d-4c7d-b003-672527fcb533 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:40 devstack sudo[108208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5566c89-b94d-4c7d-b003-672527fcb533 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf
Sep 25 15:23:40 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:41 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5566c89-b94d-4c7d-b003-672527fcb533 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf" returned: 0 in 0.333s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:41 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf is being set with open permissions: ugo+rw
Sep 25 15:23:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:41 devstack sudo[108213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf
Sep 25 15:23:41 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:41 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf" returned: 0 in 0.259s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:41 devstack sudo[108216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.info
Sep 25 15:23:41 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:41 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.info" returned: 0 in 0.241s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:41 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.info is being set with open permissions: ugo+rw
Sep 25 15:23:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:41 devstack sudo[108219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.info
Sep 25 15:23:41 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:41 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:41 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.info" returned: 0 in 0.250s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:42 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:42 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-46bac7a1-7160-400b-9a40-9cf77c60cd49 tempest-ProjectMemberTests-200391913 None] Create snapshot completed successfully
Sep 25 15:23:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-77d3bb96-4e55-4bcc-a5aa-01503be70faf-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Lock "cinder-77d3bb96-4e55-4bcc-a5aa-01503be70faf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-e5566c89-b94d-4c7d-b003-672527fcb533" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-e5566c89-b94d-4c7d-b003-672527fcb533" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-77d3bb96-4e55-4bcc-a5aa-01503be70faf" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:43 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-77d3bb96-4e55-4bcc-a5aa-01503be70faf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Deleting offline snapshot 77d3bb96-4e55-4bcc-a5aa-01503be70faf of volume e5566c89-b94d-4c7d-b003-672527fcb533 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:23:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] snapshot_file for this snap is: volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:23:43 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5adb020-be6b-49ab-82cd-7252abd2c5ff]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:43 devstack sudo[108222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf
Sep 25 15:23:43 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:43 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf" returned: 0 in 0.395s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:43 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5566c89-b94d-4c7d-b003-672527fcb533(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:23:43 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7ebda1-84e6-4187-b83b-c2f161750446]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:43 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:43 devstack sudo[108227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533
Sep 25 15:23:43 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:44 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533" returned: 0 in 0.382s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:44 devstack sudo[108232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf
Sep 25 15:23:44 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:44 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf" returned: 0 in 0.381s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:44 devstack sudo[108237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf
Sep 25 15:23:44 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:44 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:44 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533.77d3bb96-4e55-4bcc-a5aa-01503be70faf" returned: 0 in 0.278s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-77d3bb96-4e55-4bcc-a5aa-01503be70faf" released by "_delete_snapshot" :: held 1.551s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-e5566c89-b94d-4c7d-b003-672527fcb533" released by "delete_snapshot" :: held 1.576s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:44 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Created reservations ['1af8018f-7fdd-470f-8b93-7c7c58f9b2b2', 'f400d473-104f-4957-9cc8-1f6edb3d0230', 'e7bbdfe4-c8f7-4486-b0f1-7d35c7036cb2', '95dc7935-b67d-4f55-bea3-229a078132f8'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:44 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Delete snapshot completed successfully.
Sep 25 15:23:44 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e6319e62-19ba-4558-9258-fcbcfeeb1b10 tempest-ProjectMemberTests-200391913 None] Lock "cinder-77d3bb96-4e55-4bcc-a5aa-01503be70faf-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-e5566c89-b94d-4c7d-b003-672527fcb533-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Lock "cinder-e5566c89-b94d-4c7d-b003-672527fcb533-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-e5566c89-b94d-4c7d-b003-672527fcb533" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:45 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-e5566c89-b94d-4c7d-b003-672527fcb533" acquired by "delete_volume" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:45 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcc1fc9-05a4-4674-a658-2c5f3bf6d7fe]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:45 devstack sudo[108240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533
Sep 25 15:23:45 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:45 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533" returned: 0 in 0.408s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:45 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:45 devstack sudo[108245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533
Sep 25 15:23:45 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:46 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-e5566c89-b94d-4c7d-b003-672527fcb533" returned: 0 in 0.272s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-e5566c89-b94d-4c7d-b003-672527fcb533" released by "delete_volume" :: held 0.755s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:46 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Created reservations ['d8718bb7-96c4-4601-b9b9-eea85947bde4', '2766e285-4b1e-45bb-9a48-d6d4296ebedb', '347c3890-27f4-4baa-abca-48b6e7b51462', '4f2429ff-5243-40e5-bfff-960d8fb4bc85'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:46 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:46 devstack sudo[108248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:23:46 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:46 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:46 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.272s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:46 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:23:46 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Deleted volume successfully.
Sep 25 15:23:46 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-94e283bc-d8fa-4835-81bb-3d7d5058e3a6 tempest-ProjectMemberTests-200391913 None] Lock "cinder-e5566c89-b94d-4c7d-b003-672527fcb533-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (58d4b63f-4633-4e80-9765-08c08ae52bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca04d6ad-17fa-4c3c-bccf-2d7b56011fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca04d6ad-17fa-4c3c-bccf-2d7b56011fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-33946276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c01957-4c84-44e2-9307-28ef2475b542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:23:47Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d16d474-89e1-488c-a83a-1564f9c7a8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d16d474-89e1-488c-a83a-1564f9c7a8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2b1589-c61a-498d-805c-0dab7b37b53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2b1589-c61a-498d-805c-0dab7b37b53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54c01957-4c84-44e2-9307-28ef2475b542', 'volume_name': 'volume-54c01957-4c84-44e2-9307-28ef2475b542', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18228bbb-0170-45b6-aced-9afb27f6f5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18228bbb-0170-45b6-aced-9afb27f6f5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3479ec1e-aa12-4dfa-a01a-42602859c3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:47 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Volume 54c01957-4c84-44e2-9307-28ef2475b542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54c01957-4c84-44e2-9307-28ef2475b542', 'volume_size': 1}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-33946276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c01957-4c84-44e2-9307-28ef2475b542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:23:47Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Creating volume 54c01957-4c84-44e2-9307-28ef2475b542 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:23:47 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:47 devstack sudo[108251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542 1073741824
Sep 25 15:23:47 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:47 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542 1073741824" returned: 0 in 0.495s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=124,cinder:UPDATE=158,cinder:DELETE=19,cinder:INSERT=50 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:23:47 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:47 devstack sudo[108256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542
Sep 25 15:23:47 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:48 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542" returned: 0 in 0.291s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:48 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:23:48 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3479ec1e-aa12-4dfa-a01a-42602859c3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54c01957-4c84-44e2-9307-28ef2475b542', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bb5551-dace-42eb-8d8c-af0553daf1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:48 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Volume volume-54c01957-4c84-44e2-9307-28ef2475b542 (54c01957-4c84-44e2-9307-28ef2475b542): created successfully
Sep 25 15:23:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bb5551-dace-42eb-8d8c-af0553daf1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:48 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (58d4b63f-4633-4e80-9765-08c08ae52bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:48 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-681594f4-95e2-4d6a-9aa9-5dd6cda77f52 tempest-ProjectMemberTests-200391913 None] Created volume successfully.
Sep 25 15:23:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:49 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] Creating offline snapshot ec524e81-1c6a-42da-94fa-13f5c1a40b64 of volume 54c01957-4c84-44e2-9307-28ef2475b542 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:23:49 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[279735a1-e6b2-44cc-acc0-4556b653c674]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:49 devstack sudo[108260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542
Sep 25 15:23:49 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:49 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542" returned: 0 in 0.408s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:49 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:49 devstack sudo[108265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64 1G
Sep 25 15:23:49 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:50 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64 1G" returned: 0 in 0.474s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54c01957-4c84-44e2-9307-28ef2475b542 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:50 devstack sudo[108272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54c01957-4c84-44e2-9307-28ef2475b542 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64
Sep 25 15:23:50 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:50 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54c01957-4c84-44e2-9307-28ef2475b542 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64" returned: 0 in 0.338s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:50 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64 is being set with open permissions: ugo+rw
Sep 25 15:23:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:50 devstack sudo[108278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64
Sep 25 15:23:50 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:50 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64" returned: 0 in 0.272s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:50 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:51 devstack sudo[108281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.info
Sep 25 15:23:51 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:51 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.info" returned: 0 in 0.297s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:51 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.info is being set with open permissions: ugo+rw
Sep 25 15:23:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:51 devstack sudo[108284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.info
Sep 25 15:23:51 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:51 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.info" returned: 0 in 0.284s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:51 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:51 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-10a31216-ed23-4205-aed5-fa8c755a77c5 tempest-ProjectMemberTests-200391913 None] Create snapshot completed successfully
Sep 25 15:23:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-ec524e81-1c6a-42da-94fa-13f5c1a40b64-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Lock "cinder-ec524e81-1c6a-42da-94fa-13f5c1a40b64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-54c01957-4c84-44e2-9307-28ef2475b542" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-54c01957-4c84-44e2-9307-28ef2475b542" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-ec524e81-1c6a-42da-94fa-13f5c1a40b64" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:52 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-ec524e81-1c6a-42da-94fa-13f5c1a40b64" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Deleting offline snapshot ec524e81-1c6a-42da-94fa-13f5c1a40b64 of volume 54c01957-4c84-44e2-9307-28ef2475b542 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:23:52 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] snapshot_file for this snap is: volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:23:52 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a421fd7-f681-46e4-8c59-1f4051e01a1a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:52 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:52 devstack sudo[108289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64
Sep 25 15:23:52 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:53 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64" returned: 0 in 0.415s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:53 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54c01957-4c84-44e2-9307-28ef2475b542(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:23:53 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f1c531-af92-43a5-bbc3-e3d0a27b795a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:53 devstack sudo[108294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542
Sep 25 15:23:53 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:53 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542" returned: 0 in 0.421s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:53 devstack sudo[108299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64
Sep 25 15:23:53 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:53 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64" returned: 0 in 0.395s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:53 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:53 devstack sudo[108304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64
Sep 25 15:23:53 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:54 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542.ec524e81-1c6a-42da-94fa-13f5c1a40b64" returned: 0 in 0.285s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-ec524e81-1c6a-42da-94fa-13f5c1a40b64" released by "_delete_snapshot" :: held 1.630s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-54c01957-4c84-44e2-9307-28ef2475b542" released by "delete_snapshot" :: held 1.654s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:54 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Created reservations ['60f4a974-2a83-41ff-b70a-b7316c806c38', '7f3f285c-5ded-4d56-a2b4-86f40814832e', '2ecdcd2a-5770-43ff-9a7f-63e69f903f28', '09f2d7c4-7413-4cb5-b9ae-ece27fa17759'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:54 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Delete snapshot completed successfully.
Sep 25 15:23:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-bce50fae-4d58-4461-a4da-ea9960b65652 tempest-ProjectMemberTests-200391913 None] Lock "cinder-ec524e81-1c6a-42da-94fa-13f5c1a40b64-delete_snapshot" released by "delete_snapshot" :: held 1.824s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-54c01957-4c84-44e2-9307-28ef2475b542-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Lock "cinder-54c01957-4c84-44e2-9307-28ef2475b542-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-54c01957-4c84-44e2-9307-28ef2475b542" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:23:54 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-54c01957-4c84-44e2-9307-28ef2475b542" acquired by "delete_volume" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:23:54 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1035ce0d-b258-4004-afc3-7ebd5b57946a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:54 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:55 devstack sudo[108307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542
Sep 25 15:23:55 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:55 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542" returned: 0 in 0.388s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:55 devstack sudo[108312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542
Sep 25 15:23:55 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:55 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-54c01957-4c84-44e2-9307-28ef2475b542" returned: 0 in 0.276s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:55 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-54c01957-4c84-44e2-9307-28ef2475b542" released by "delete_volume" :: held 0.747s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:55 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Created reservations ['20f94bea-2c6a-4ba1-af0c-26d734807587', 'c98d473f-a716-4091-aa75-733417b77580', 'c1b71e7c-7fc7-4a66-b665-c81a8e16afbd', '8abb4da8-61e2-47ac-857b-df61fc204a29'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:23:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:55 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:55 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:55 devstack sudo[108315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:23:55 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:56 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.291s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:23:56 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Deleted volume successfully.
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-77b0a961-905c-4842-9e37-dd4f64d9fb88 tempest-ProjectMemberTests-200391913 None] Lock "cinder-54c01957-4c84-44e2-9307-28ef2475b542-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (2893e279-f76f-4a9c-a168-9b70e7a26d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dbd0eaf-2176-4e42-85ed-3c053020f66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dbd0eaf-2176-4e42-85ed-3c053020f66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1699365231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7b3cb2-c0eb-4584-94a7-37da76721ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:23:56Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd00073-9324-4761-95ab-f992a774b7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd00073-9324-4761-95ab-f992a774b7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45a7ce3-a482-4332-a2b7-bf64e904eeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45a7ce3-a482-4332-a2b7-bf64e904eeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce7b3cb2-c0eb-4584-94a7-37da76721ac0', 'volume_name': 'volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea90aea-5dfe-4274-80d4-dc044373803b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea90aea-5dfe-4274-80d4-dc044373803b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b4b5b5-1bde-4499-9526-b87c88513c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:56 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Volume ce7b3cb2-c0eb-4584-94a7-37da76721ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0', 'volume_size': 1}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1699365231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7b3cb2-c0eb-4584-94a7-37da76721ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:23:56Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Creating volume ce7b3cb2-c0eb-4584-94a7-37da76721ac0 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:23:56 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:23:56 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:56 devstack sudo[108324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0 1073741824
Sep 25 15:23:56 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:57 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0 1073741824" returned: 0 in 0.475s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:57 devstack sudo[108329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0
Sep 25 15:23:57 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:57 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0" returned: 0 in 0.279s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:57 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:23:57 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:23:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b4b5b5-1bde-4499-9526-b87c88513c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87e10f4-2433-4d2c-ac5e-9ff348fb31b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:23:57 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Volume volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0 (ce7b3cb2-c0eb-4584-94a7-37da76721ac0): created successfully
Sep 25 15:23:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87e10f4-2433-4d2c-ac5e-9ff348fb31b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:23:57 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (2893e279-f76f-4a9c-a168-9b70e7a26d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:23:57 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-54281a3a-e348-4f53-b01f-ddc1ab90f27e tempest-ProjectMemberTests-200391913 None] Created volume successfully.
Sep 25 15:23:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:23:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:23:58 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] Creating offline snapshot bdc951e6-b089-411d-a6da-02eeb612ddd1 of volume ce7b3cb2-c0eb-4584-94a7-37da76721ac0 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:23:58 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba03dbbc-83b4-4ec3-9c83-5864e0a082f0]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:23:58 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:58 devstack sudo[108333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0
Sep 25 15:23:58 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:59 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0" returned: 0 in 0.407s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:59 devstack sudo[108338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1 1G
Sep 25 15:23:59 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:59 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1 1G" returned: 0 in 0.421s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:59 devstack sudo[108343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1
Sep 25 15:23:59 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:23:59 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root
Sep 25 15:23:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1" returned: 0 in 0.292s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:23:59 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1 is being set with open permissions: ugo+rw
Sep 25 15:23:59 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:23:59 devstack sudo[108348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1
Sep 25 15:23:59 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:00 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1" returned: 0 in 0.271s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:00 devstack sudo[108351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.info
Sep 25 15:24:00 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:00 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.info" returned: 0 in 0.280s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:00 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.info is being set with open permissions: ugo+rw
Sep 25 15:24:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:00 devstack sudo[108354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.info
Sep 25 15:24:00 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:00 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.info" returned: 0 in 0.299s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:00 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:24:00 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-0b0e2b31-f097-41be-bfa0-25e9a468e5f2 tempest-ProjectMemberTests-200391913 None] Create snapshot completed successfully
Sep 25 15:24:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-bdc951e6-b089-411d-a6da-02eeb612ddd1-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Lock "cinder-bdc951e6-b089-411d-a6da-02eeb612ddd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-ce7b3cb2-c0eb-4584-94a7-37da76721ac0" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-ce7b3cb2-c0eb-4584-94a7-37da76721ac0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-bdc951e6-b089-411d-a6da-02eeb612ddd1" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:01 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-bdc951e6-b089-411d-a6da-02eeb612ddd1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:01 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Deleting offline snapshot bdc951e6-b089-411d-a6da-02eeb612ddd1 of volume ce7b3cb2-c0eb-4584-94a7-37da76721ac0 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:24:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] snapshot_file for this snap is: volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:24:02 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[598484bd-839e-4590-a5c6-e76d1d8fbcb0]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:24:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:02 devstack sudo[108357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1
Sep 25 15:24:02 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:02 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1" returned: 0 in 0.438s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:02 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:24:02 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b48abd6-a987-471a-ba01-8801354e4069]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:24:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:02 devstack sudo[108362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0
Sep 25 15:24:02 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:02 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0" returned: 0 in 0.396s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:02 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:02 devstack sudo[108367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1
Sep 25 15:24:02 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:03 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1" returned: 0 in 0.387s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:03 devstack sudo[108372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1
Sep 25 15:24:03 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:03 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:03 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0.bdc951e6-b089-411d-a6da-02eeb612ddd1" returned: 0 in 0.285s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-bdc951e6-b089-411d-a6da-02eeb612ddd1" released by "_delete_snapshot" :: held 1.622s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-ce7b3cb2-c0eb-4584-94a7-37da76721ac0" released by "delete_snapshot" :: held 1.648s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:03 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Created reservations ['4945b638-4966-484d-8ba9-bf2b8a643c99', 'd72cfed1-6ca6-4935-ba6d-78a288219cd5', 'f77b8759-ebab-4105-a052-63d475a5aac6', 'f076feef-8180-40f8-9bfc-e0392afb2c67'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:24:03 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Delete snapshot completed successfully.
Sep 25 15:24:03 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-e27cec45-1839-4a82-aa41-0e5716c559ca tempest-ProjectMemberTests-200391913 None] Lock "cinder-bdc951e6-b089-411d-a6da-02eeb612ddd1-delete_snapshot" released by "delete_snapshot" :: held 1.804s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-ce7b3cb2-c0eb-4584-94a7-37da76721ac0-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Lock "cinder-ce7b3cb2-c0eb-4584-94a7-37da76721ac0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-ce7b3cb2-c0eb-4584-94a7-37da76721ac0" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-ce7b3cb2-c0eb-4584-94a7-37da76721ac0" acquired by "delete_volume" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:04 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[05569860-5321-4c44-bf69-95f50f1d9fd2]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:24:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:04 devstack sudo[108375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0
Sep 25 15:24:04 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:04 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0" returned: 0 in 0.391s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:04 devstack sudo[108380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0
Sep 25 15:24:04 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:04 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:04 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-ce7b3cb2-c0eb-4584-94a7-37da76721ac0" returned: 0 in 0.273s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:04 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-ce7b3cb2-c0eb-4584-94a7-37da76721ac0" released by "delete_volume" :: held 0.728s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:04 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Created reservations ['8efb093e-78d9-459a-ab2c-8add6968afc8', '045295db-d488-432e-af18-9562f41afc0f', '9f235d7f-111d-40b4-afbb-3b1c00fef491', '201274f4-24b9-4a86-a2da-4323cd39ca7b'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:05 devstack sudo[108383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:24:05 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:05 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.257s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:24:05 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Deleted volume successfully.
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-1339b7f4-eaa3-4eb5-b21f-07bea2d1ab97 tempest-ProjectMemberTests-200391913 None] Lock "cinder-ce7b3cb2-c0eb-4584-94a7-37da76721ac0-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (2f9b098e-b2bd-4484-a511-ad1f4c71b002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5087527-7a19-44c5-b0f7-0807cdd4ab3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5087527-7a19-44c5-b0f7-0807cdd4ab3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-132995880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30387efe-87cc-434d-a0f8-f85e1899493d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:24:06Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8d0ca8-21d8-4487-a3f6-5fd24b027446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8d0ca8-21d8-4487-a3f6-5fd24b027446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf494d75-3f8f-497b-bdca-887b0d032936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf494d75-3f8f-497b-bdca-887b0d032936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30387efe-87cc-434d-a0f8-f85e1899493d', 'volume_name': 'volume-30387efe-87cc-434d-a0f8-f85e1899493d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0201de0-9b88-42e3-96d3-ca0df52d0c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0201de0-9b88-42e3-96d3-ca0df52d0c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f607ea-132e-46b8-9faf-0706ba38422d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:05 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Volume 30387efe-87cc-434d-a0f8-f85e1899493d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30387efe-87cc-434d-a0f8-f85e1899493d', 'volume_size': 1}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-132995880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30387efe-87cc-434d-a0f8-f85e1899493d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:24:06Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Creating volume 30387efe-87cc-434d-a0f8-f85e1899493d {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:24:05 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:24:05 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:05 devstack sudo[108386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d 1073741824
Sep 25 15:24:05 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:06 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d 1073741824" returned: 0 in 0.438s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:06 devstack sudo[108391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d
Sep 25 15:24:06 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:06 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d" returned: 0 in 0.269s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:06 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:24:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:24:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f607ea-132e-46b8-9faf-0706ba38422d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30387efe-87cc-434d-a0f8-f85e1899493d', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45c7919-311a-4da2-8f1a-a221a2d07121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:06 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Volume volume-30387efe-87cc-434d-a0f8-f85e1899493d (30387efe-87cc-434d-a0f8-f85e1899493d): created successfully
Sep 25 15:24:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45c7919-311a-4da2-8f1a-a221a2d07121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:06 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (2f9b098e-b2bd-4484-a511-ad1f4c71b002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:24:06 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-a6ad9622-0d9b-4a1e-aec2-834ddc3fb00d tempest-ProjectMemberTests-200391913 None] Created volume successfully.
Sep 25 15:24:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:24:06 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:24:07 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] Creating offline snapshot 3488e7b3-a26a-47ce-83d5-3efe7d104437 of volume 30387efe-87cc-434d-a0f8-f85e1899493d {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:24:07 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebb7979-05f6-4414-877c-36a921dc6f0d]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:24:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:07 devstack sudo[108394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d
Sep 25 15:24:07 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:07 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d" returned: 0 in 0.384s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:07 devstack sudo[108399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437 1G
Sep 25 15:24:07 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:07 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437 1G" returned: 0 in 0.450s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:07 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30387efe-87cc-434d-a0f8-f85e1899493d -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:07 devstack sudo[108405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30387efe-87cc-434d-a0f8-f85e1899493d -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437
Sep 25 15:24:07 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:08 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30387efe-87cc-434d-a0f8-f85e1899493d -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437" returned: 0 in 0.292s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:08 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437 is being set with open permissions: ugo+rw
Sep 25 15:24:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:08 devstack sudo[108411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437
Sep 25 15:24:08 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:08 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437" returned: 0 in 0.247s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:08 devstack sudo[108414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.info
Sep 25 15:24:08 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:08 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.info" returned: 0 in 0.260s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:08 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.info is being set with open permissions: ugo+rw
Sep 25 15:24:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:08 devstack sudo[108417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.info
Sep 25 15:24:08 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:08 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.info" returned: 0 in 0.256s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:08 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.983s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:24:08 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e16d5003-43bf-43cf-9f6a-c4a4826c423e tempest-ProjectMemberTests-200391913 None] Create snapshot completed successfully
Sep 25 15:24:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-3488e7b3-a26a-47ce-83d5-3efe7d104437-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Lock "cinder-3488e7b3-a26a-47ce-83d5-3efe7d104437-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-30387efe-87cc-434d-a0f8-f85e1899493d" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-30387efe-87cc-434d-a0f8-f85e1899493d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-3488e7b3-a26a-47ce-83d5-3efe7d104437" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:09 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-3488e7b3-a26a-47ce-83d5-3efe7d104437" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Deleting offline snapshot 3488e7b3-a26a-47ce-83d5-3efe7d104437 of volume 30387efe-87cc-434d-a0f8-f85e1899493d {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:24:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] snapshot_file for this snap is: volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:24:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b98a7b-03e8-4e44-9688-210f1a80516c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:24:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:09 devstack sudo[108420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437
Sep 25 15:24:09 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:09 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437" returned: 0 in 0.461s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:09 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30387efe-87cc-434d-a0f8-f85e1899493d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:24:09 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fa7f0a-2fcf-41d3-a550-552f069c8c90]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:24:09 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:09 devstack sudo[108426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d
Sep 25 15:24:09 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:10 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d" returned: 0 in 0.402s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:10 devstack sudo[108431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437
Sep 25 15:24:10 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:10 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437" returned: 0 in 0.411s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:10 devstack sudo[108436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437
Sep 25 15:24:10 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:10 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:10 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d.3488e7b3-a26a-47ce-83d5-3efe7d104437" returned: 0 in 0.306s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-3488e7b3-a26a-47ce-83d5-3efe7d104437" released by "_delete_snapshot" :: held 1.697s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:10 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-30387efe-87cc-434d-a0f8-f85e1899493d" released by "delete_snapshot" :: held 1.722s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:10 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Created reservations ['f59a9e72-a497-4541-9fd9-34c1f12fd848', '695893ce-9321-4ad1-b780-840839616f35', 'a14ca95b-5e6d-454b-b155-fc608f7faaac', '6889dd40-ae9a-4f91-90be-3b9eb0e0c4b1'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:24:11 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Delete snapshot completed successfully.
Sep 25 15:24:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-2968cff0-7e32-449f-a6be-7593b8126367 tempest-ProjectMemberTests-200391913 None] Lock "cinder-3488e7b3-a26a-47ce-83d5-3efe7d104437-delete_snapshot" released by "delete_snapshot" :: held 1.893s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-30387efe-87cc-434d-a0f8-f85e1899493d-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Lock "cinder-30387efe-87cc-434d-a0f8-f85e1899493d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-30387efe-87cc-434d-a0f8-f85e1899493d" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:11 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-30387efe-87cc-434d-a0f8-f85e1899493d" acquired by "delete_volume" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:11 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab121f6c-3c39-4fb9-a23f-a13f873228f7]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:24:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:11 devstack sudo[108439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d
Sep 25 15:24:11 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:11 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d" returned: 0 in 0.425s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:11 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:11 devstack sudo[108444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d
Sep 25 15:24:11 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:12 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-30387efe-87cc-434d-a0f8-f85e1899493d" returned: 0 in 0.258s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-30387efe-87cc-434d-a0f8-f85e1899493d" released by "delete_volume" :: held 0.752s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:12 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Created reservations ['69c88184-0225-44a6-a948-d856429a4417', '9919fa80-730b-43cc-b2e7-75252b5e326c', '2313a1ff-adf3-4993-946b-90953be49a7b', 'b84c4a0a-1851-462c-8e8a-a800a4ec6176'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:24:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:24:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:24:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:24:12 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:24:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:24:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:12 devstack sudo[108447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:24:12 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:12 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:12 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.288s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:12 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:24:12 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Deleted volume successfully.
Sep 25 15:24:12 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5beadceb-456c-4bd9-8222-784480b5302f tempest-ProjectMemberTests-200391913 None] Lock "cinder-30387efe-87cc-434d-a0f8-f85e1899493d-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (7c78ed51-4ca4-44a8-8e10-aa4ce74d938c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def65102-53d8-42c6-bee9-30fd0e52f800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def65102-53d8-42c6-bee9-30fd0e52f800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-559133532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eecf33c4-0be1-46d0-9ba0-1eb63025dffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:24:13Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e680a7-ef69-47b7-be46-42810e27ba73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e680a7-ef69-47b7-be46-42810e27ba73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb395c7-0e9c-4955-81db-6bac53555a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb395c7-0e9c-4955-81db-6bac53555a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eecf33c4-0be1-46d0-9ba0-1eb63025dffc', 'volume_name': 'volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632cec07-b87c-4fba-bccb-4ad44bc2218c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632cec07-b87c-4fba-bccb-4ad44bc2218c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c931fd-cd7f-4856-970f-8d2e72fb8ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:13 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Volume eecf33c4-0be1-46d0-9ba0-1eb63025dffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc', 'volume_size': 1}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-559133532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eecf33c4-0be1-46d0-9ba0-1eb63025dffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:24:13Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Creating volume eecf33c4-0be1-46d0-9ba0-1eb63025dffc {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:24:13 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:13 devstack sudo[108450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc 1073741824
Sep 25 15:24:13 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:13 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc 1073741824" returned: 0 in 0.472s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:13 devstack sudo[108455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc
Sep 25 15:24:13 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:13 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc" returned: 0 in 0.292s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c931fd-cd7f-4856-970f-8d2e72fb8ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:13 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86de22bc-a93b-4ee4-b764-b58651a2a57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:14 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Volume volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc (eecf33c4-0be1-46d0-9ba0-1eb63025dffc): created successfully
Sep 25 15:24:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86de22bc-a93b-4ee4-b764-b58651a2a57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:14 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (7c78ed51-4ca4-44a8-8e10-aa4ce74d938c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:24:14 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e02bf9c8-4b69-4eab-a394-21e83ac43c7d tempest-ProjectMemberTests-200391913 None] Created volume successfully.
Sep 25 15:24:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:24:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:24:15 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] Creating offline snapshot dad8942f-88cd-4ca8-be19-cc74417e3b95 of volume eecf33c4-0be1-46d0-9ba0-1eb63025dffc {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:24:15 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ef9fb4-1b22-4778-afe8-f0d169792a8c]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:24:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:15 devstack sudo[108494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc
Sep 25 15:24:15 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:15 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc" returned: 0 in 0.395s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:15 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:15 devstack sudo[108499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95 1G
Sep 25 15:24:15 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:16 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95 1G" returned: 0 in 0.473s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:16 devstack sudo[108504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95
Sep 25 15:24:16 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:16 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95" returned: 0 in 0.370s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:16 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95 is being set with open permissions: ugo+rw
Sep 25 15:24:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:16 devstack sudo[108509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95
Sep 25 15:24:16 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:16 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95" returned: 0 in 0.291s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:16 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:SELECT=105,cinder:INSERT=35,cinder:UPDATE=144,cinder:DELETE=9 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:24:16 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:16 devstack sudo[108512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.info
Sep 25 15:24:16 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:17 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.info" returned: 0 in 0.273s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:17 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.info is being set with open permissions: ugo+rw
Sep 25 15:24:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:17 devstack sudo[108515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.info
Sep 25 15:24:17 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:17 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.info" returned: 0 in 0.283s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:17 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:24:17 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-05dad635-3964-4d79-acc2-eaaf215729e2 tempest-ProjectMemberTests-200391913 None] Create snapshot completed successfully
Sep 25 15:24:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-dad8942f-88cd-4ca8-be19-cc74417e3b95-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Lock "cinder-dad8942f-88cd-4ca8-be19-cc74417e3b95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-eecf33c4-0be1-46d0-9ba0-1eb63025dffc" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-eecf33c4-0be1-46d0-9ba0-1eb63025dffc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-dad8942f-88cd-4ca8-be19-cc74417e3b95" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:18 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-dad8942f-88cd-4ca8-be19-cc74417e3b95" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Deleting offline snapshot dad8942f-88cd-4ca8-be19-cc74417e3b95 of volume eecf33c4-0be1-46d0-9ba0-1eb63025dffc {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:24:18 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] snapshot_file for this snap is: volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:24:18 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[784f509d-d5d6-4b88-9373-97253b502dbb]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:24:18 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:18 devstack sudo[108519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95
Sep 25 15:24:18 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:19 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95" returned: 0 in 0.378s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:19 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:24:19 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c021266-dcae-4424-afeb-3b031dac548a]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:24:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:19 devstack sudo[108524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc
Sep 25 15:24:19 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:19 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc" returned: 0 in 0.373s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:19 devstack sudo[108529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95
Sep 25 15:24:19 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:19 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95" returned: 0 in 0.370s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:19 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:19 devstack sudo[108534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95
Sep 25 15:24:19 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:20 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc.dad8942f-88cd-4ca8-be19-cc74417e3b95" returned: 0 in 0.241s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-dad8942f-88cd-4ca8-be19-cc74417e3b95" released by "_delete_snapshot" :: held 1.459s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-eecf33c4-0be1-46d0-9ba0-1eb63025dffc" released by "delete_snapshot" :: held 1.483s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Created reservations ['6dabe10e-e95e-471a-aec0-9713407c6ef5', '191df9fc-5405-4b80-a23c-0a784a83c5ae', 'ef085163-1784-4233-907d-8511639a554d', '794d0de8-e9d8-45ea-9cac-4a0533fe9ea2'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:24:20 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Delete snapshot completed successfully.
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-3440e023-4c68-41b8-b4f8-8caa1735dcba tempest-ProjectMemberTests-200391913 None] Lock "cinder-dad8942f-88cd-4ca8-be19-cc74417e3b95-delete_snapshot" released by "delete_snapshot" :: held 1.634s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-eecf33c4-0be1-46d0-9ba0-1eb63025dffc-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Lock "cinder-eecf33c4-0be1-46d0-9ba0-1eb63025dffc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-eecf33c4-0be1-46d0-9ba0-1eb63025dffc" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-eecf33c4-0be1-46d0-9ba0-1eb63025dffc" acquired by "delete_volume" :: waited 0.021s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace5bdf7-5a98-4fb4-8801-3a45d6babaf9]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:24:20 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:20 devstack sudo[108537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc
Sep 25 15:24:20 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:21 devstack sudo[108538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:24:21 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:21 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.300s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:21 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:24:21 devstack cinder-volume[87071]: DEBUG oslo_service.periodic_task [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] Running periodic task VolumeManager._thread_info {{(pid=87071) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 15:24:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread count: 29 {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 15:24:21 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:21 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-bae639cf-c2da-4fe7-9e9d-83efb923ce0b None None] thread info: [<_MainThread(MainThread, started 129983647768704)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129983534235328)>, <Thread(Thread-3 (stat_writer), started daemon 129983533745216)>, <Thread(Rabbit-heartbeat, started daemon 129983536562304)>, <Thread(Thread-5 (_runner), started daemon 129983531398592)>, <Thread(Thread-7 (_runner), started daemon 129983531598336)>, <Thread(fd_logger, started daemon 129983529485248)>, <Thread(privsep_reader, started daemon 129983529255104)>, <Thread(tpool_thread_0, started daemon 129983522866880)>, <Thread(tpool_thread_1, started daemon 129983514474176)>, <Thread(tpool_thread_2, started daemon 129983506081472)>, <Thread(tpool_thread_3, started daemon 129983497688768)>, <Thread(tpool_thread_4, started daemon 129983489296064)>, <Thread(tpool_thread_5, started daemon 129983480903360)>, <Thread(tpool_thread_6, started daemon 129983472510656)>, <Thread(tpool_thread_7, started daemon 129983464117952)>, <Thread(tpool_thread_8, started daemon 129983455725248)>, <Thread(tpool_thread_9, started daemon 129983447332544)>, <Thread(tpool_thread_10, started daemon 129983438939840)>, <Thread(tpool_thread_11, started daemon 129983430530752)>, <Thread(tpool_thread_12, started daemon 129983422121664)>, <Thread(tpool_thread_13, started daemon 129983413712576)>, <Thread(tpool_thread_14, started daemon 129983405303488)>, <Thread(tpool_thread_15, started daemon 129983396894400)>, <Thread(tpool_thread_16, started daemon 129983388485312)>, <Thread(tpool_thread_17, started daemon 129983380076224)>, <Thread(tpool_thread_18, started daemon 129983371667136)>, <Thread(tpool_thread_19, started daemon 129983363258048)>, <Thread(Rabbit-heartbeat, started daemon 129983531771584)>] {{(pid=87071) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 15:24:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc" returned: 0 in 0.423s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:21 devstack sudo[108545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc
Sep 25 15:24:21 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:21 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-eecf33c4-0be1-46d0-9ba0-1eb63025dffc" returned: 0 in 0.275s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:21 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-eecf33c4-0be1-46d0-9ba0-1eb63025dffc" released by "delete_volume" :: held 0.768s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:21 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Created reservations ['ed4577f9-b96d-4b18-9151-ac88ee93637c', 'd37a768c-b9ba-41d8-bb0b-e56431ff2ec1', 'e1c22d88-2acb-4bb9-986b-ec82125cac1c', '571511a3-b954-4393-b849-3bc9f2167851'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:24:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:24:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:24:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:24:21 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:24:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:24:21 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:21 devstack sudo[108548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:24:21 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:22 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.293s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:24:22 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Deleted volume successfully.
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-5ca0a92c-a9ba-444a-b8ec-0e886f66c42c tempest-ProjectMemberTests-200391913 None] Lock "cinder-eecf33c4-0be1-46d0-9ba0-1eb63025dffc-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87071) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (62272aaf-eea0-46a0-abfd-2d62f1523708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50e276d-da80-445d-8d61-82614c24852f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50e276d-da80-445d-8d61-82614c24852f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-68643967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afeb16e6-a78b-477f-9a75-7e1028779df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:24:22Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0746b08-a5f3-4238-b164-e241158fb853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0746b08-a5f3-4238-b164-e241158fb853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcece344-5c5a-44ba-bdf7-1011ce64cdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcece344-5c5a-44ba-bdf7-1011ce64cdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afeb16e6-a78b-477f-9a75-7e1028779df3', 'volume_name': 'volume-afeb16e6-a78b-477f-9a75-7e1028779df3', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3848fa6-ac45-4542-8b67-1f9c27db378d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3848fa6-ac45-4542-8b67-1f9c27db378d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51e32be-c827-42f3-b7cc-07a97fa7fb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:22 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Volume afeb16e6-a78b-477f-9a75-7e1028779df3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afeb16e6-a78b-477f-9a75-7e1028779df3', 'volume_size': 1}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76382674f980>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T13:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-68643967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afeb16e6-a78b-477f-9a75-7e1028779df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9113eb6785a453499bfa40e35ca3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T13:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T13:24:22Z,use_quota=True,user_id='19efb4110871426d83a54bf2a5b6cae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(965fca63-eb69-49f2-86d3-2baca7744e27),volume_type_id=965fca63-eb69-49f2-86d3-2baca7744e27)}" {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Creating volume afeb16e6-a78b-477f-9a75-7e1028779df3 {{(pid=87071) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Selected osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf as target Quobyte volume. {{(pid=87071) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 15:24:22 devstack cinder-volume[87071]: INFO cinder.volume.drivers.remotefs [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] casted to osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf
Sep 25 15:24:22 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3 1073741824 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:22 devstack sudo[108551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3 1073741824
Sep 25 15:24:22 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:23 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3 1073741824" returned: 0 in 0.469s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:23 devstack sudo[108557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3
Sep 25 15:24:23 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:23 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3" returned: 0 in 0.283s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:23 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'} {{(pid=87071) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 15:24:23 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:24:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51e32be-c827-42f3-b7cc-07a97fa7fb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afeb16e6-a78b-477f-9a75-7e1028779df3', 'volume_size': 1}' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93213ef5-8b7e-4299-b8d2-caa007593965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 15:24:23 devstack cinder-volume[87071]: INFO cinder.volume.flows.manager.create_volume [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Volume volume-afeb16e6-a78b-477f-9a75-7e1028779df3 (afeb16e6-a78b-477f-9a75-7e1028779df3): created successfully
Sep 25 15:24:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93213ef5-8b7e-4299-b8d2-caa007593965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87071) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 15:24:23 devstack cinder-volume[87071]: DEBUG cinder.volume.manager [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Flow 'volume_create_manager' (62272aaf-eea0-46a0-abfd-2d62f1523708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87071) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 15:24:23 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-e4500901-bfe7-4568-b94a-6c9d24a360a2 tempest-ProjectMemberTests-200391913 None] Created volume successfully.
Sep 25 15:24:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:24:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:24:24 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] Creating offline snapshot 82429ace-0abc-46e3-b504-5d851422aa3d of volume afeb16e6-a78b-477f-9a75-7e1028779df3 {{(pid=87071) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 15:24:24 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9f7591-4926-4cd1-9271-ea81c43ad6d3]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:24:24 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:24 devstack sudo[108560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3
Sep 25 15:24:24 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:25 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3" returned: 0 in 0.384s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d 1G {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:25 devstack sudo[108565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d 1G
Sep 25 15:24:25 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:25 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d 1G" returned: 0 in 0.447s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afeb16e6-a78b-477f-9a75-7e1028779df3 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:25 devstack sudo[108570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afeb16e6-a78b-477f-9a75-7e1028779df3 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d
Sep 25 15:24:25 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:25 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afeb16e6-a78b-477f-9a75-7e1028779df3 -F qcow2 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d" returned: 0 in 0.314s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:25 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d is being set with open permissions: ugo+rw
Sep 25 15:24:25 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:25 devstack sudo[108575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d
Sep 25 15:24:25 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:26 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d" returned: 0 in 0.268s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:26 devstack sudo[108578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.info
Sep 25 15:24:26 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:26 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.info" returned: 0 in 0.280s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:26 devstack cinder-volume[87071]: WARNING cinder.volume.drivers.remotefs [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.info is being set with open permissions: ugo+rw
Sep 25 15:24:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.info {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:26 devstack sudo[108581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.info
Sep 25 15:24:26 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:26 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.info" returned: 0 in 0.307s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:26 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.097s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:24:26 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-4fe68b8f-3860-4177-8127-109391c5bafe tempest-ProjectMemberTests-200391913 None] Create snapshot completed successfully
Sep 25 15:24:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-82429ace-0abc-46e3-b504-5d851422aa3d-delete_snapshot" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Lock "cinder-82429ace-0abc-46e3-b504-5d851422aa3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-afeb16e6-a78b-477f-9a75-7e1028779df3" by "delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-afeb16e6-a78b-477f-9a75-7e1028779df3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-82429ace-0abc-46e3-b504-5d851422aa3d" by "_delete_snapshot" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:28 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-82429ace-0abc-46e3-b504-5d851422aa3d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Deleting offline snapshot 82429ace-0abc-46e3-b504-5d851422aa3d of volume afeb16e6-a78b-477f-9a75-7e1028779df3 {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 15:24:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] snapshot_file for this snap is: volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d {{(pid=87071) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 15:24:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c269798-1e00-4368-8569-021005702b42]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:24:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:28 devstack sudo[108585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d
Sep 25 15:24:28 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:28 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d" returned: 0 in 0.440s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:28 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.remotefs [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afeb16e6-a78b-477f-9a75-7e1028779df3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87071) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 15:24:28 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b84524-4797-4683-b74d-1b0db0fc29a2]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:24:28 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:28 devstack sudo[108590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3
Sep 25 15:24:28 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:29 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3" returned: 0 in 0.395s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:29 devstack sudo[108595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d
Sep 25 15:24:29 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:29 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d" returned: 0 in 0.373s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:29 devstack sudo[108600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d
Sep 25 15:24:29 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:29 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:29 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3.82429ace-0abc-46e3-b504-5d851422aa3d" returned: 0 in 0.273s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-82429ace-0abc-46e3-b504-5d851422aa3d" released by "_delete_snapshot" :: held 1.599s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-afeb16e6-a78b-477f-9a75-7e1028779df3" released by "delete_snapshot" :: held 1.625s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:29 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Created reservations ['5a32709c-edf9-46b2-8cf4-b70d53902e9b', 'b0f4a951-6450-4672-a1e3-306e83799f80', 'a6fb5cb5-7d4c-4438-aca7-9448ff5bb41a', '4dc79026-f180-41d6-817f-931b117f3437'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:24:29 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Delete snapshot completed successfully.
Sep 25 15:24:29 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-30220f1c-acae-4b54-b9b7-6be1225ca87a tempest-ProjectMemberTests-200391913 None] Lock "cinder-82429ace-0abc-46e3-b504-5d851422aa3d-delete_snapshot" released by "delete_snapshot" :: held 1.799s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-afeb16e6-a78b-477f-9a75-7e1028779df3-delete_volume" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Lock "cinder-afeb16e6-a78b-477f-9a75-7e1028779df3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Acquiring lock "cinder-quobyte-afeb16e6-a78b-477f-9a75-7e1028779df3" by "delete_volume" {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 15:24:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-afeb16e6-a78b-477f-9a75-7e1028779df3" acquired by "delete_volume" :: waited 0.013s {{(pid=87071) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 15:24:30 devstack cinder-volume[87071]: DEBUG oslo.privsep.daemon [-] privsep: reply[658e617b-574a-4689-b927-26f25e8bf85b]: (4, 'qcow2') {{(pid=88380) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 15:24:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:30 devstack sudo[108603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3
Sep 25 15:24:30 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:30 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3" returned: 0 in 0.369s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:30 devstack sudo[108608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3
Sep 25 15:24:30 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:30 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:30 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170/volume-afeb16e6-a78b-477f-9a75-7e1028779df3" returned: 0 in 0.245s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:30 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Lock "cinder-quobyte-afeb16e6-a78b-477f-9a75-7e1028779df3" released by "delete_volume" :: held 0.679s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:31 devstack cinder-volume[87071]: DEBUG cinder.quota [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Created reservations ['fddd6ea7-03ef-4e15-86e6-9be447687cea', '480e748f-1f66-4843-941e-6d9228264fdf', '1e7f3db5-9d24-4c59-89af-9691b7646e1d', '88788ae7-2935-4715-98a9-d608961c6f95'] {{(pid=87071) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 15:24:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 15:24:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 15:24:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf': None} {{(pid=87071) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 15:24:31 devstack cinder-volume[87071]: DEBUG cinder.volume.drivers.quobyte [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3defeea8-7de1-488b-a8d3-a7d1b7ab2adf'] {{(pid=87071) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 15:24:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.lockutils [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87071) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 15:24:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170 {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 15:24:31 devstack sudo[108611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170
Sep 25 15:24:31 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 15:24:31 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root
Sep 25 15:24:31 devstack cinder-volume[87071]: DEBUG oslo_concurrency.processutils [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/15168d56b1874807d87e129da1a4a170" returned: 0 in 0.260s {{(pid=87071) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 15:24:31 devstack cinder-volume[87071]: DEBUG cinder.manager [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Notifying Schedulers of capabilities ... {{(pid=87071) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 15:24:31 devstack cinder-volume[87071]: INFO cinder.volume.manager [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Deleted volume successfully.
Sep 25 15:24:31 devstack cinder-volume[87071]: DEBUG cinder.coordination [None req-d613d4e8-13fc-4791-a06f-80177ecc290e tempest-ProjectMemberTests-200391913 None] Lock "cinder-afeb16e6-a78b-477f-9a75-7e1028779df3-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87071) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 15:24:41 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=32,cinder:SELECT=21,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 15:24:41 devstack cinder-volume[87071]: DEBUG dbcounter [-] [87071] Writing DB stats cinder:UPDATE=88,cinder:SELECT=72,cinder:INSERT=23,cinder:DELETE=8 {{(pid=87071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}